Top Skills Details
1. Data engineer who has worked with ML experts and their requirements to optimize columnar databases using python as a back end technology (use clickhouse for columnar database but open to other technologies)
2. Need to have worked within a cloud environment, our customer is AWS so that is the preference but open to other technologies
3. This person should not only be comfortable optimizing databases but modeling them as well because optimization comes after modeling
What we’re looking for…
*** Client*** is seeking an AI Database Optimization Engineer who will help shape the system and solution design of *** Client*** most advanced GenAI offerings. Ideal candidates will be passionate and have had proven expertise in database technologies especially columnar data modeling, query optimization and OLAP. You would be responsible to make sure the various system databases are well-structured to support downstream model training.
You are ever curious and hungry to learn, with a bias toward action and delivering value to the customer quickly. We are building out a leading-edge, AI-first monitoring analytics platform for *** Client*** customers and prospects. The capabilities of this platform will eclipse what other observability vendors are bringing. This is the product you\'ll be working on.
What you’ll be doing…
• As the lead AI database optimization engineer, you\'ll resonate with and embody our core values –
• Empathy: We empathize with our customers to help them solve core problems. Our empathy also extends to our team as we enable people to experiment, grow and do their best work.
• Ownership: Joining at an early stage of this product\'s design and implementation, you will be expected to own large parts of the product and work through high ambiguity without explicit direction. You will also be expected to bring forth feedback and ideas to help shape the product.
• Communication: Strong communication is required to work through ambiguity and showcase clarity of thought when interacting with customers, prospects, and the team.
• Ambition: We are here to solve hard problems and want to bring on board people who seek out challenges and want to excel. Have something to prove about yourself? Willing to put in the necessary effort to overcome a lack of particular education or experience? You’ll make your mark here.
• You will be working key leaders of our Analytics group including CTO of Skylar AI to develop core offering and help build out the team.
Qualities you possess…
• Enterprise experience working with highly scalable and performant databases like Clickhouse: Modeling and creating OLAP cubes for exploration. Mastery in query optimization and database system design.
• Governance and guard-rail monitoring of production databases: Having participated in large scale data product deployment, you will help setup best practices around maintaining robust schema and entity modeling.
• Understanding of ML Training Data and User Feedback: Guiding the data scientists to collect the right data for fine-tuning, relevance ranking optimization, and benchmarking.
• BS/MS/PhD in Computer Science, similar technical field of study, or equivalent practical experience.
• 5+ experience with software engineering developing and deploying production-level code for highly scalable distributed systems.
• Experience with following tech stack
o Frontend: React UI, Swagger APIs
o Backend: Python, ClickHouse, OpenTelemetry
o Cloud: Mostly AWS, but on-prem is deployed via HELM, as a cloud-native app
o ML: HuggingFace Python libs, PostgresML, Pytorch, OpenAI
Are you looking for remote jobs near your area? At Yulys, thousands of employers are looking for exceptional talent like yours. Find a perfect job now.