Data Engineering is the foundational layer of our Data & Analytics stack at Arrive. Data Engineers not only build and optimize data pipelines that transform and store data in a way that allows the rest of the organization (analysts, data scientists, other stakeholders) analyze and consume data. They are also in charge of building the systems and establishing the processes to enable the rest of the data team to develop, test, and deploy analyses and code in an efficient and scalable way.
We’re looking for a Senior Data Engineer to lead the scale and execution of our data infrastructure and platform. If you're seeking a role that is high impact and full of ownership....please read on.
What you'll tackle:
Design new enterprise data models and ETL processes to populate themExtract and transform data from production databases and 3rd party services to provide consumable data and support functions across the organizationDetect quality issues, track them to their root source, and implement fixes and preventative auditsManage and optimize Redshift clusters/data lake to ensure current health and performance and future scaling needsHelp maintain the process we use to develop, test, and deploy good codeBecome the “go to” expert of our data. Work closely with staff to understand all data from our core systems, partner services, and any other platforms we rely on
What you brIng to the table:
Experience with AWS; expertise in Redshift, Postgres or other RDBSs (preferably column-oriented)Expertise in SQL and ability to write and optimize complex queriesExperience with Docker, Elastic Container Service, Lambda a plusAbility to write customized software in Python, Bash, Go or other common open source languages. Experience with Airflow or similar scheduling service a plusExperience with CI/CD tools like Jenkins or DroneCreativity in approaching data organization challenges with an understanding of the end goalA collaborative nature and entrepreneurial spirit. Prior startup experience a huge plus
More about the team:
We are a tight knit team that is fun, inclusive, and hard working. We have a firm, non-negotiable no jerk policy. We accept you for who you are and consider everyone on an equal opportunity basis without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.