Senior Data Engineer
Perpetua
About Flywheel
Opportunity
What you'll do:
- Steward data and compute environments to facilitate usage of data assets.
- Design, build, test and deploy scalable and reusable systems that handle large amounts of data.
- Lead and mentor a small team of developers.
- Perform code reviews and provide leadership and guidance to junior developers.
- Learn and teach new technologies to the team.
Who you are:
- Experience designing and managing data flows.
- Experience designing systems and APIs to integrate data into applications.
- 8+ years of Linux, Bash, Python, and SQL experience.
- 4+ years using Spark and other Hadoop ecosystem software.
- 4+ years using AWS cloud services, esp. EMR, Glue, Athena, and Redshift.
- Passion for Technology: Excitement for new technology, bleeding edge applications, and a positive attitude towards solving real world challenges.
Additional Skills:
- BS, MS or PhD in Computer Science, Engineering, or equivalent real-world experience (You've learned something to be able to claim you are an engineer).
- Significant experience with Python, C++, or other popular language.
- Experience with big data and/or infrastructure. Bonus for having experience in setting up Petabytes of data so they can be easily accessed. Understanding of data organization, i.e., partitioning, clustering, file sizes, file formats. Data cataloging with Hive/Hive metastore or Glue or something similar.
- Experience working with relational databases.
- Experience with Hadoop, Hive, Spark, or other data processing tools.
- Experience in any of the modern data stack technologies like dbt, airbyte is desired.
- Experience building scalable data pipelines (Airflow experience a plus).
- Significant experience working with AWS and/or GCP.
- Proven ability to independently execute projects from concept to implementation to launch and to maintain a live product.
Flywheel Commerce Network is committed to fair and equitable compensation practices. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to skill set, depth of experience, certifications, and specific work location.
Working at Flywheel
- We have office hubs across the globe where team members can go to feel productive, inspired, and connected to others - team members go into Hub Offices 3x a week
- Competitive paid time off, including annual leave plus paid public holidays
- Great learning and development opportunities
- Benefits that help you live your best life
- Parental leave and benefits
- Volunteering opportunities
- If you’re looking to connect with teammates on a topic of inclusion and identity, chances are there’s an ERG for that.
- So you know: The hired candidate will be required to complete a background check
- Learn more about us here: Life at Flywheel
The Interview Process:
Inclusive Workforce
Flywheel Commerce Network’s goal is to create a culture where all individuals of all backgrounds feel comfortable in bringing their authentic selves to work. We want all people to feel included and empowered to contribute fully to our vision and goals. Flywheel Commerce Network is an Equal Opportunity Employer and participates in E-Verify. All applicants will receive fair consideration for employment. We do not discriminate based upon race, color, religion, sex, sexual orientation, age, marital status, gender identity, national origin, disability, or any other applicable legally protected characteristics in the location in which the candidate is applying.
If you have any accessibility requirements that would make you more comfortable during the application and interview process, please let us know at recruitment@flywheeldigital.com so that we can support you.