Data Engineering Manager
Data | Remote | Full Time
Spokeo is a people search engine that both enlightens and empowers our customers. With over 12 billion records and 18 million visitors per month, we reconnect friends, reunite families, prevent fraud, and more. Every day our nimble team takes on enormous challenges in data science that push the limits of the cloud and search architecture.
As the Data Engineering Manager, you will lead and mentor the Data Engineering team responsible for processing the public record data powering Spokeo’s people-search products. This is an exciting opportunity to help transform the quality of the data we process, partnering with business stakeholders, data scientists, and big data developers. The ideal candidate will have an understanding of the challenges associated with big data aggregation with a focus on automation and data quality.
Collaborating with stakeholders to define the orchestration of source-to-target mappings and data integration workflows
Development of scalable, extensible, and robust automation components, using tools such as Airflow, Jenkins and scripting languages as necessary.
Developing and mentoring the data engineering team, ensuring that best practices are implemented for data workflow, data governance, data quality, and related activities.
Track cost and performance metrics for data pipeline resources, helping to evolve and optimize the workflows
Assisting in production support by resolving source data issues and refining transformation rules when needed.
Collaborating with stakeholders to design and develop our data warehouse, data marts, and data models
B.S. in Computer Science, Information Systems, or related fields.
5+ years development experience in highly scalable, distributed systems and cluster architectures (e.g. AWS, Azure, Google Cloud, etc)
3+ years experience working in big data ecosystems, such as Spark, Hadoop, etc.
3+ years managing software developers.
Experience with data warehousing, data modeling, and database architecture.
Experience in agile environments using Scrum and/or Kanban and software development life cycle.
Excellent project management and communication skills.
Preference for open source big data experience with tools such as Hive, HBase, Parquet, Spark, etc.
Privacy Notice for Candidates: https://www.spokeo.com/recruiting-policy
Spokeo is an equal opportunity employer. Applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability, or protected veteran status. Spokeo fosters a business culture where ideas and decisions from all people help us grow, innovate, create the best products, and be relevant in a rapidly changing world.
Recruiters or staffing agencies: Spokeo is not obligated to compensate any external recruiter or search firm who presents a candidate or their resume or profile to a Spokeo employee without 1) a current, fully executed agreement on file and 2) being assigned to the open position (as a search) via our applicant tracking solution.