Data Engineer

Job Purpose:

We are looking for a Data Engineer to join our growing team of software development. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for consumption by our various products. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up (using SSIS as well as Azure Data Factory). The Data Engineer will support our software developers, database architects, data analysts on data and product initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing our company’s data architecture to support our next generation of products and data initiatives.

Job Responsibilities:

Essential Functions:

Requirements:

• Responsible for the conception, design, development, and deployment of data architecture and database objects
• Create and maintain optimal data pipeline architecture.
• Work together with various business units (BI, Product, Reporting) to develop required ETLs as well as various other SQL related tasks.
• Follow various ETL processes and maintain existing ones.
• Ensure high-performance access to diverse data sources.
• Encourage the adoption of an organization’s frameworks by providing documentation, training, sample code, and developer support
• Communicate progress on the adoption and effectiveness of the developed frameworks to department head and managers.
• Knowledge and experience of Azure data factory as well as SSIS is a must.

Required Education and Experience:

• Bachelor’s degree or equivalent combination of education and experience
• Broad understanding of SQL, essential object types like tables/views/stored procedures/functions/indexes etc…
• Experienced in building different types of ETL processes using SSIS or Azure Data Factory pipelines.
• Practical experience with developing as well as maintaining ETLs and SQL processes.
• Practical experience with most of the general ETL tools in SSIS and Azure Data Factory
• Knowledgeable of Source Control and Project Management tools like Azure Devops, Git
• Familiarity with DevOps best practices and automation of documentation, testing, build, deployment, configuration, and monitoring
• Communication skills: It is vital that applicants have exceptional written and spoken communication skills with active listening abilities to contribute in making strategic decisions and advise senior management on specialized technical issues, which will have an impact on the business
• Strong team building skills: it is crucial that they also have team building ability to provide direction for complex projects, mentor junior team members, and communicate the organization’s preferred technologies and frameworks across development teams.

Experience:

A candidate for this position must have had at least 5 years working in a data/ETL development position within a fast-paced and complex business environment, preferably working as a Data Engineer. The candidate must also have had experience developing schema, various SQL objects, in a large database environment. The candidate will also have had experience with full implementation of software development lifecycle (SDLC).

He will additionally have demonstrated knowledge of database and data modeling concepts of data mapping and modeling inclusive of normalization, referential integrity, keys, indexes, metadata, and master data.

The candidate must also have a proven and successful experience working with ETL concepts of data integration, consolidation, enrichment, and aggregation. The candidate will have had experience working with SQL server database administration, integration services. A suitable candidate will also have a strong demonstrated understanding of SSIS and its tools, Azure data factory.

The candidate must also have a proven and successful experience working with data models, star schema, facts, dimensions under a data warehouse. Troubleshooting and optimization of various things like sql objects, SSIS packages, Azure data factory is a must to have.

Analytical Skills: As expected, a candidate for the position will have passion as well as skill in research and analytics as well as a passion for data management tools and technologies. The candidate must have an ability to perform detailed data analyses, for example, in determining the content, structure, and quality of data through the examination of data samples and source systems. He will additionally have the ability to troubleshoot data warehousing issues and quickly resolve them.

Preferred Education and Experience:

• Data engineering certifications (e.g Azure Data Engineer or Architect) is a plus

Expected Competencies:

• Detailed oriented with strong organizational skills
• Ability to pay attention to programming style and neatness
• Strong English communication skills, both written and verbal
• Ability to train, mentor junior colleagues with patience with tangible results

EEO Statement

Cendyn provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability or genetics. In addition to federal law requirements, Cendyn complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

Cendyn expressly prohibits any form of workplace harassment based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status. Improper interference with the ability of Cendyn’s employees to perform their job duties may result in discipline up to and including discharge.

Other Duties

Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities and activities may change at any time with or without notice.