Senior Data Engineer – Databricks | Remote-Friendly

Anywhere

Posted 6 months ago

At Velotio, we are embracing a remote-friendly work culture where everyone has the flexibility to either work remotely or from our office in Pune.

Join us and work from wherever you feel most productive!

About Velotio:

Velotio Technologies is a product engineering company working with innovative startups and enterprises. We are a certified Great Place to Work® and recognized as one of the best companies to work for in India. We have provided full-stack product development for 110+ startups across the globe building products in the cloud-native, data engineering, B2B SaaS, IoT & Machine Learning space. Our team of 325+ elite software engineers solves hard technical problems while transforming customer ideas into successful products.

Requirements

Work closely with our clients providing evaluation and recommendations of design patterns and solutions for data platforms with a focus on ETL, ELT, ALT, lambda, and kappa architectures
Define SLAs, SLIs, and SLOs with inputs from clients, product owners, and engineers to deliver data-driven interactive experiences
Provide expertise, proof-of-concept, prototype, and reference implementations of architectural solutions for cloud, on-prem, hybrid, and edge-based data platforms
Provide technical inputs to agile processes, such as epic, story, and task definition to resolve issues and remove barriers throughout the lifecycle of client engagements
Creation and maintenance of infrastructure-as-code for cloud, on-prem, and hybrid environments using tools such as Terraform, CloudFormation, Azure Resource Manager, Helm, and Google Cloud Deployment Manager
Mentor, support and manage team members.

Desired Skills & Experience:

6+ years of demonstrable experience in enterprise level data platforms involving implementation of end-to-end data pipelines
Hands-on experience in using Databricks
Hands-on experience with at least one of the leading public cloud data platforms (Amazon Web Services, Azure or Google Cloud)
Experience with column-oriented database technologies (e.g., Big Query, Redshift, Vertica), NoSQL database technologies (e.g., DynamoDB, BigTable, Cosmos DB, etc.) and traditional database systems (e.g., SQL Server, Oracle, MySQL)
Experience in architecting data pipelines and solutions for both streaming and batch integrations using tools/frameworks like Glue ETL, Lambda, Google Cloud DataFlow, Azure Data Factory, Spark, Spark Streaming, etc.
Metadata definition and management via data catalogs, service catalogs, and stewardship tools such as OpenMetadata, DataHub, Alation, AWS Glue Catalog, Google Data Catalog.
Test plan creation and test programming using automated testing frameworks, data validation and quality frameworks, and data lineage frameworks
Data modeling, querying, and optimization for relational, NoSQL, timeseries, graph databases, data warehouses and data lakes
Data processing programming using SQL, DBT, Python, and similar tools
Logical understanding of programming in Python, Spark, PySpark, Java, Javascript, and/or Scala
Cloud-native data platform design with a focus on streaming and event-driven architectures
Participate in integrated validation and analysis sessions of components and subsystems on production servers
Data ingest, validation, and enrichment pipeline design and implementation
SDLC optimization across workstreams within a solution
Bachelor’s degree in Computer Science, Engineering, or related field

Benefits

Our Culture:

We have an autonomous and empowered work culture encouraging individuals to take ownership and grow quickly
Flat hierarchy with fast decision making and a startup-oriented “get things done” culture
A strong, fun & positive environment with regular celebrations of our success. We pride ourselves in creating an inclusive, diverse & authentic environment

Note: Currently, all interviews and onboarding processes at Velotio are being carried out remotely through virtual meetings.