Senior Data Engineer :: W2 role

Position Senior Data Engineer With AWS

Location: Bay Area

Type: Contract

JOB DESCRIPTION

Responsibilities:

• Be a hands-on data engineer, building, scaling, and optimizing self-serve ETL frameworks that can handle batch processing and/or streaming.
• Own the ETL workflows and make sure the pipeline meets data quality and availability requirements.
• Work closely with other data engineering teams to integrate schema registry and establish data lineage for all data domains.
• Work closely with our stakeholder teams, like Data Science, Product Engineering, Analytics to help them with their data computation needs.
• Joint ownership of all aspects of data - data quality, data governance, data and schema design, data quality and security
• Mentor and lead more junior engineers and help them improve their craft.

To excel in this position, you should possess the following:

• 5+ years of hands-on experience building and deploying production-quality data pipelines.
• Solid understanding of key metrics for data pipelines and experience building solutions to provide visibility to partner teams.
• 3+ years of hands-on experience using any of the Data warehouses like Snowflake, AWS Redshift, BigQuery, or Teradata.
• Expertise with a commonly-used data programming language (for example, Python, Java, SQL).
• Experience with Airflow, Terraform, and a Cloud Provider Stack (AWS, GCP, Azure)
• 2+ years of experience with data streaming technologies like Spark (AWS Glue), Flink, Storm, Kinesis, and/or Kafka
• Track record of successful partnerships with Analytics, Data Science, Security, DevOps and Product Engineering teams.