Consultant, Data Engineer | Databricks

About this role

If you’re passionate about being part of a dynamic organization that enables a Fortune 100 company with nearly $70 billion in annual sales to drive innovation and adopt new technologies that deliver business results, then Nationwide’s Technology team could be the place for you! At Nationwide®, “on your side” goes beyond just words. Our customers are at the center of everything we do and we’re looking for associates who are passionate about delivering extraordinary care.

This Consultant, Data Engineer will join the Altoids line within the Enterprise Data Office to support ITDM Modernization and the associated Enterprise Data Lakehouse (EDL) being created to enable it.

What you will do • Design and build Databricks and Delta Lake data pipelines that move ITDM data into reliable, reusable EDL layers.

• Develop Python and SQL transformations, data models, and data-quality checks that support IT demand, capacity, cost, and related reporting needs.

• Help establish scalable lakehouse patterns for ingestion, harmonization, curation, incremental processing, and downstream consumption.

• Partner with Altoids engineers, product managers, architects, analysts, and business stakeholders to translate ITDM needs into technical solutions and sprint-ready work.

• Troubleshoot pipeline, data-quality, and performance issues and contribute to monitoring, documentation, and production support.

• Create reusable engineering patterns and documentation that strengthen the EDL foundation and accelerate future ITDM delivery.

What you bring • At least 3+ years of strong hands-on experience with Databricks (, Delta Lake, Python, and SQL.

• Experience building and supporting enterprise data pipelines and lakehouse or data-platform solutions.

• Understanding of data quality, data modeling, performance optimization, and production operations.

• Ability to communicate clearly, work collaboratively in an Agile team, and turn complex data needs into maintainable solutions.

Success in this role means helping Altoids deliver a trusted, scalable Enterprise Data Lakehouse.

Work Authorization: This role does not qualify for employer-sponsored work authorization. Nationwide does not participate in the STEM OPT Extension program. Work Arrangement: This role follows a hybrid schedule and requires in-office presence in our Columbus OH two days per week. Candidates must be based within a commutable distance to Columbus, Ohio.

#LI-KR1

Job Description Summary Nationwide’s industry leading workforce is passionate about creating data solutions that are secure, reliable and efficient in support of our mission to provide extraordinary care. Nationwide embraces an agile work environment and collaborative culture through the understanding of business processes, relationship entities and requirements using data analysis, quality, visualization, governance, engineering, robotic process automation, and machine learning to produce targeted data solutions. If you have the drive and desire to be part of a future forward data enabled culture, we want to hear from you.

As a Data Engineer you’ll be responsible for acquiring, curating, and publishing data for analytical or operational uses. Data should be in a ready-to-use form that creates a single version of the truth across all data consumers, including business users, data scientists, and Technology. Ready-to-use data can be for both real time and batch data processes and may include unstructured data. Successful data engineers have the skills typically required for the full lifecycle software engineering development from translating requirements into design, development, testing, deployment, and production maintenance tasks. You’ll have the opportunity to work with various technologies from big data, relational and SQL databases, unstructured data technology, and programming languages. Job Description Key Responsibilities:   • Consults on complex data product projects by analyzing moderate to complex end to end data product requirements and existing business processes to lead in the design, development and implementation of data products.

• Responsible for producing data building blocks, data models, and data flows for varying client demands such as dimensional data, standard and ad hoc reporting, data feeds, dashboard reporting, and data science research & exploration.

• Translates business data stories into a technical story breakdown structure and work estimate so value and fit for a schedule or sprint.

• Responsible for applying secure software and systems engineering practices throughout the delivery lifecycle to ensure our data and technology solutions are protected from threats and vulnerabilities.

• Creates business user access methods to structured and unstructured data by such techniques such as mapping data to a common data model, NLP, transforming data as necessary to satisfy business rules, AI, statistical computations and validation of data content. 

• Builds data cleansing, imputation, and common data meaning and standardization routines from source systems by understanding business and source system data practices and by using data profiling and source data change monitoring, extraction, ingestion and curation data flows.

• Facilitates medium to large-scale data using cloud technologies – Azure and AWS (i.e. Redshift, S3, EC2, Data-pipeline and other big data technologies).

• Collaborates with enterprise DevSecOps team and other internal organizations on CI/CD best practices experience using JIRA, Jenkins, Confluence etc.

• Implements production processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.

• Develops and maintains scalable data pipelines for both streaming and batch requirements and builds out new API integrations to support continuing increases in data volume and complexity

• Writes and performs data unit/integration tests for da

Similar jobs

• Digital Consulting - Databricks Technical Architect - Manager — Huron · Remote
• Data Engineer I (Databricks, SQL) — Travelers · CT - Hartford | MN - St. Paul
• Data Architect, Databricks — McKesson · Columbus, OH | Irving, TX, USA - 6555 North State Highway 161 (P001) | Remote, United States
• Forward Deployed Data Engineer - Databricks — Accenturefederalservices · Washington, DC
• Senior Software Engineer (Databricks Platform Engineer) — Vizient · Irving, TX 75062 Vizient Corporate HQ | Chicago, IL | Edina, MN
• Data Engineer I (Databricks, AWS, Python) — Travelers · CT - Hartford | MN - St. Paul | MD - Hunt Valley
• Data Engineer I (AWS, Databricks) — Travelers · CT - Hartford
• Data Engineer II - Databricks Platform — Travelers · CT - Hartford | MN - St. Paul | MD - Hunt Valley