Principal Software Engineer, Big Data
Engineering | Palo Alto, CA | Full Time
ShareThis is a big data company that owns online behavior data of 1b+ users globally. We are developing an audience intelligence platform with cutting edge big data technologies. We are looking for innovative software engineer to join our exciting projects and platform development.
You will be responsible for big data software and platform architecture and development.
What we expect from you
- 15+ years of experience in big data software and platform development
- Fluent in two or more of the programming languages such as Scala, Java, Python, GoLang
- Knowledge of microservices & serverless architectures
- Experience building large CI/CD pipelines
- Extensive hands-on experiences in Spark and AWS EMR
- Extensive experiences with AWS (S3, SQS, EMR etc)
- Strong automation skills with Python and/or Bash
- Experience with Airflow
- Experience working in fast-paced Agile teams
- Ability to learn new tools and workflows with little or no supervision
- Education· BS/MS in Computer Science or Software Engineering
Nice to have some of the following
- Experience with AWS.
- Experience with SQL/NoSQL Database
- Working knowledge of Security and Privacy in big data platform
- Google Bigquery
- Experience with Azure, Snowflake is a plus