Ihre aktuelle Jobsuche

Overview:

We are seeking a highly skilled and experienced Senior Data Engineer to join our team. The ideal candidate will possess a strong background in data architecture, management, and integration, particularly within the energy commodities or financial services sectors. This role will involve designing robust data solutions, ensuring data quality, and implementing ETL processes to support our business objectives.



Key Responsibilities:

* Data Architecture Development: Design, implement, and maintain scalable and reliable data architecture frameworks that support the organization's strategic goals and objectives.
* ETL/ELT Design and Implementation: Architect and develop ETL and ELT processes utilizing SnapLogic and other integration tools to extract, transform, and load data from various sources into centralized data stores.
* Data Modeling: Collaborate with business stakeholders to create comprehensive data models, optimizing logical and physical data design and ensuring alignment with business requirements.
* Data Management and Governance: Establish and enforce data management best practices, including data governance frameworks to ensure data accuracy, consistency, and availability across the organization.
* Quality Assurance: Conduct comprehensive data quality assessments and audits, identifying and resolving data issues to maintain high standards of data integrity.
* Data Integration: Facilitate seamless data integration across various systems and platforms by developing and maintaining data ingestion pipelines that support real-time and batch processing.
* Collaboration with Teams: Work closely with data scientists, business analysts, and software engineers to understand data needs and provide suitable data solutions and architecture for analytics and reporting.
* Cloud Database Management: Manage relational and non-relational databases using Snowflake and Oracle, including performance tuning, optimization, and effective indexing strategies.
* Data Analysis and Visualization: Utilize Python and business intelligence tools (Power BI, Tableau) to analyze complex datasets and create meaningful visualizations and reports that facilitate data-driven decision-making.
* Machine Learning Implementation: Collaborate with machine learning practitioners to implement machine learning solutions, ensuring the proper infrastructure and data pipelines are in place to support model development and deployment.
* Training and Knowledge Transfer: Mentor and train junior staff, providing knowledge transfer on data architecture and engineering best practices, tools, and technologies.
* Vendor Management: Evaluate, select, and manage relationships with vendors and technology partners to integrate new data tools and solutions, staying abreast of vendor trends that impact data strategies.
* Research and Innovation: Stay current with emerging trends, technologies, and best practices in data architecture, big data analytics, and AI/ML, recommending innovative solutions that enhance the organization's data capabilities.



Relevant Skills and Qualifications:

* Bachelor's degree in Computer Science, Information Technology, Data Science, or a related field; Master's degree preferred.
* Proven experience in data architecture, data engineering, or a related field.
* Proficiency in SQL, T-SQL, and data modeling techniques.
* Experience with ETL/ELT tools, specifically SnapLogic.
* Familiarity with cloud data warehousing solutions, particularly Snowflake or Oracle.
* Strong programming skills in Python, with experience in data libraries such as Pandas and NumPy.
* Familiarity with modern data integration and data pipeline architectures.
* Knowledge of machine learning and artificial intelligence concepts and tools.
* Experience using BI tools (Power BI, Tableau) for data visualization and reporting.
* Excellent analytical skills with a focus on data quality and management.
* Strong communication and interpersonal skills, with experience in vendor management.

Our TOP CLIENT has retained us for a Sr Data Engineer role. They are known and highly recognized for their stability and commitment to a collaborative teamwork environment. Our client is building a best-in-class data science platform as being on the forefront of data management and analytics is core to our investment platform. Overall, this position will play an integral role as the team implements new data management platforms, creates new data ingestion pipelines, and sources new data sets. The role will assist with all aspects of data from data architecture design to on-going data management and will have significant exposure to our Risk and commercial investing teams globally.



REQUIRED:

Must be onsite 3 days a week in the Houston, TX area

Extensive work experience with ETL/ELT frameworks to write pipelines.

Advanced skills in writing highly optimized SQL code.

Experience with Snowflake.



TOP RESPONSIBILITIES:

Execute data architecture and data management projects for both new and existing data sources.

Help transition existing data sets, databases, and code to a new technology stack.

Over time, lead analysis of data sets using a variety of techniques including machine learning.

Manage end to end data ingestion process and publishing to investing teams.

Own the process of mapping, standardizing, and normalizing data.

Ad hoc research on project topics such as vendor trends, usage best practices, big data trends, artificial intelligence, vendors, etc.

Help transition existing data sets, databases, and code to a new technology stack.

Assess data loads for tactical errors and build out appropriate workflows, as well as create data quality analysis that identifies larger issues in data.

Actively manage vendors and capture changes in data input proactively.

Properly prioritize and resolve data issues based on business usage.

Assist with managing strategic initiatives around big data projects for the commercial (trading) business.

Partner with commercial teams to gain understanding of current data flow, data architecture, investment process as well as gather functional requirements.

Assess gaps in current datasets and remediate.



PREFERRED SKILLS:

Experience in SQL programming, data architecture, and dimension modeling.

Interest and passion for data architecture, analytics, management, and programming.

Experience in energy commodities or financial services required.

Experience in mapping, standardizing, and normalizing data.

Experience with data integration platforms is preferred, and SnapLogic experience is highly preferred.

Extensive work experience with ETL/ELT frameworks to write pipelines to load millions of records.

Advanced skills in writing highly optimized SQL code.

Experience with relational databases Snowflake or Oracle is preferred.

Python work experience with Pandas, Numpy and Scikit

Ability to communicate and interact with a wide range of data users - from very technical to non-technical.

Team player who is execution focused, with the able to handle a rapidly changing set of projects. and priorities, while maintaining strong professional presence.

Strong analytics skills with demonstrated attention to details.

Familiarity with Business intelligence tools Power BI and Tableau.

Interest or experience in machine learning/Artificial Intelligence is a plus.



BENEFITS:

Competitive comprehensive medical, dental, retirement and life insurance benefits

Employee assistance & wellness programs

Parental and family leave policies

CCI in the Community: Each office has a Charity Committee and as a part of this program employees are allocated 2 days annually to volunteer at the selected charities.

Charitable contribution match program

Tuition assistance & reimbursement

Quarterly Innovation & Collaboration Awards

Employee discount program, including access to fitness facilities

Competitive paid time off

Continued learning opportunities



Reach out to me directly if interested:

E: s.murray@jeffersonfrank.com

Role: Cloud Infrastructure Engineer
Location: Hybrid (2x a week in Whippany, NJ)
Salary: $135k base plus potential for bonus

Role Requirements:

* Proficiency in IaC using CloudFormation.
* Experience with serverless technologies (Lambda, DynamoDB, API Gateway, etc.).
* Strong AWS experience.
* Azure DevOps knowledge is a plus.
* Background in enterprise environments preferred.
* Familiarity with VPC, ALB/NLB, ASG, EC2, ECS, S3, DNS, and Storage Gateway.

Day-to-Day Responsibilities:

* Provision and manage highly scalable, redundant AWS infrastructure.
* Transition on-premise infrastructure to the cloud and oversee ongoing cloud operations.
* Support 3rd-party hosted data centers and cloud systems.
* Lead migration of legacy systems to cloud environments.
* Work on websites for drug assistance programs, ensuring resilience and scalability.

Role: Cloud Infrastructure Engineer
Location: Hybrid
Salary: $135k base plus potential for bonus

Role Requirements:

* Proficiency in IaC using CloudFormation.
* Experience with serverless technologies (Lambda, DynamoDB, API Gateway, etc.).
* Strong AWS experience.
* Azure DevOps knowledge is a plus.
* Background in enterprise environments preferred.
* Familiarity with VPC, ALB/NLB, ASG, EC2, ECS, S3, DNS, and Storage Gateway.

Day-to-Day Responsibilities:

* Provision and manage highly scalable, redundant AWS infrastructure.
* Transition on-premise infrastructure to the cloud and oversee ongoing cloud operations.
* Support 3rd-party hosted data centers and cloud systems.
* Lead migration of legacy systems to cloud environments.
* Work on websites for drug assistance programs, ensuring resilience and scalability.

Role: Cloud Infrastructure Engineer
Location: Hybrid
Salary: $135k base plus potential for bonus

Role Requirements:

* Proficiency in IaC using CloudFormation.
* Experience with serverless technologies (Lambda, DynamoDB, API Gateway, etc.).
* Strong AWS experience.
* Azure DevOps knowledge is a plus.
* Background in enterprise environments preferred.
* Familiarity with VPC, ALB/NLB, ASG, EC2, ECS, S3, DNS, and Storage Gateway.

Day-to-Day Responsibilities:

* Provision and manage highly scalable, redundant AWS infrastructure.
* Transition on-premise infrastructure to the cloud and oversee ongoing cloud operations.
* Support 3rd-party hosted data centers and cloud systems.
* Lead migration of legacy systems to cloud environments.
* Work on websites for drug assistance programs, ensuring resilience and scalability.

DevOps Engineer (AI Focused)

Location: Hyrbid in Philadephia

Compensation: $130,000 - $150,000

* Relocation support available

Overview:
This role offers an exciting opportunity to join a collaborative, learning-focused team. The organization is forming a brand-new team dedicated to a cutting-edge chatbot project aimed at housing proprietary customer information. This is an impactful role, as you will help shape the team and make key decisions.

Key Responsibilities:

* Work on the development of a proprietary chatbot project.
* Play a pivotal role in forming a new team and contributing to technical decision-making.
* Collaborate with cross-functional teams in a fast-paced, innovative environment.

Qualifications:

* Experience: Around 5 years in relevant fields.
* DevOps Expertise: Strong understanding required.
* Programming: Proficiency in Python is mandatory.
* AI Expertise: At least 2 years of hands-on experience with AI technologies.
* Cloud Platforms: Experience with Azure, AWS, or GCP.
* Containerization: Familiarity with Docker and Kubernetes (nice to have).
* Tech Stacks: Exposure to ELK stack and RAG stack is a plus.

Culture:

* Collaborative and innovative environment.
* Commitment to continuous learning and professional growth.
* Fun and dynamic office atmosphere.

Note: This is an opportunity to work on a groundbreaking project while contributing to a growing team within an established organization.

Job Title: AWS Container Platform Engineer

Location: Hybrid (1 day per week on-site in Reston, VA). Remote candidates considered if located outside the DMV area (working EST hours).

Company Overview: A well-established health insurance organization is seeking an experienced AWS Container Platform Engineer to lead a major cloud migration effort. This company, with deep roots and a commitment to innovative solutions, provides an opportunity to make significant technical contributions.

Key Responsibilities:

* Lead and act as the subject matter expert for a large-scale migration project from on-premises to AWS EKS, involving the transfer of 9 million lines of code for core applications.
* Drive the successful containerization process and contribute to an active, high-impact project.
* Collaborate closely with teams to ensure the migration is seamless and efficient from start to finish.
* Focus on execution rather than consulting, with hands-on involvement throughout the project.

Qualifications:

* Strong expertise in containerization, particularly with EKS, ECS, Docker, and Kubernetes (K8s).
* Advanced AWS experience, covering EC2, S3, EBS, EFS, IAM, VPC, Lambda, and related services.
* Proficiency in Terraform for Infrastructure as Code (IaC).
* In-depth understanding of CI/CD pipelines and DevOps practices.
* Scripting skills in Python, Bash, or similar languages.
* Certifications in AWS or Kubernetes are preferred but not required.

Ideal Candidate:

* A proven track record of leading complete containerization projects (end-to-end) and driving results.
* Hands-on experience is essential; candidates with purely consulting backgrounds may not be the right fit.

This role is perfect for those looking to take ownership of a significant migration project and contribute expertise in a high-impact environment.

Job Title: Data Analyst/ Developer

Location: Remote (light travel)

Salary: Competitive

Role Overview:

The SQL Developer will be the primary data expert on the team, taking over database responsibilities from leadership and developers. This role involves working collaboratively across different teams to provide database expertise, build reports for data visualization, and manage data imports from various external sources.

Role Requirements:

* 3-5 years of experience with PostgreSQL databases (admin and development)
* Experience with Amazon RDS
* Proficiency in PostgreSQL
* Advanced SQL coding skills

Responsibilities:

* Own and manage the company's databases, taking over from other team members
* Assist various business teams in accessing and using data effectively
* Build reports for visualization using tools like QuickSight
* Handle data imports from healthcare partners using formats like CSV, SQL to SQL, and EDI calls
* Pull and manage data to fulfill user requests, primarily in the healthcare space
* Design, configure, and manage database systems
* Work as the sole data professional within the team, collaborating with leadership and developers

Day-to-Day Tasks:

* Managing and maintaining databases, ensuring high performance and accessibility
* Supporting business operations by developing data visualizations and analytical reports
* Collaborating with cross-functional teams to streamline data access and reporting
* Overseeing data import processes and ensuring smooth integration with existing systems
* Responding to and managing data-related requests and issues
* Designing and implementing robust database structures and best practices

Role: Cloud Infrastructure Engineer
Location: Hybrid (2x a week in Whippany, NJ)
Salary: $135k base plus potential for bonus

Role Requirements:

* Proficiency in IaC using CloudFormation.
* Experience with serverless technologies (Lambda, DynamoDB, API Gateway, etc.).
* Strong AWS experience.
* Azure DevOps knowledge is a plus.
* Background in enterprise environments preferred.
* Familiarity with VPC, ALB/NLB, ASG, EC2, ECS, S3, DNS, and Storage Gateway.

Day-to-Day Responsibilities:

* Provision and manage highly scalable, redundant AWS infrastructure.
* Transition on-premise infrastructure to the cloud and oversee ongoing cloud operations.
* Support 3rd-party hosted data centers and cloud systems.
* Lead migration of legacy systems to cloud environments.
* Work on websites for drug assistance programs, ensuring resilience and scalability.

Job Description:

The Data Solutions Architect is responsible for providing technical leadership and guidance on end-to-end data management systems and modern data platform architecture patterns. Provides optimal architecture recommendations for creating data foundational services that support several key internal and external customer applications. The Data Solution Architect will work as a liaison between the business divisions, product engineering, cloud platform and security teams.

The Data Solutions Architect will be part of the enterprise architecture group and be a key contributor in defining enterprise architecture standards, supporting enterprise architecture data program roadmap, technology modernization and optimization strategies. Also, the Data Solutions Architect is expected to have a results-oriented mindset, foster an environment of continuous improvement, and have a proven record as a technology leader.

Role & Responsibilities

* Oversee the feasibility assessment or develop a vision for solutions and patterns related to new services or technologies that facilitate technology modernization and support the enterprise architecture data initiative.
* Demonstrate proficiency in formulating long-term data strategies that align with business goals to realize desired outcomes.
* Have experience in implementing data compliance privacy controls and measures for GDPR and CCPA.
* Skilled in converting business requirements into technical specifications, securing stakeholder approval, and assisting with change management processes.
* Design, maintain, and enhance cloud architectures to ensure they are scalable, reliable, and cost-efficient.
* Take initiative in identifying shortcomings or potential improvements, conducting proof-of-concept evaluations for new analytics technologies and data management tools.
* Collaborate closely with data owners, scrum teams, and security and infrastructure personnel for technical reviews of solutions, while consulting with the enterprise architecture review board to ensure compliance with enterprise architecture and security standards.
* Engage effectively with cross-functional teams to clearly communicate and implement enterprise data architecture standards.
* Support the comprehensive technical vision for data analytics and governance areas that form part of an architectural solution and modernization approach.
* Exhibit the ability to work autonomously with minimal oversight.
* Prove to be highly capable in diagnosing problems, conducting research, and proposing practical and cost-effective solutions.
* Have a successful history as the lead cloud architect for extensive and complex cloud modernization initiatives.
* Often take on a leadership role, sharing advanced strategies and insights to promote a data-driven culture and imparting newly acquired technical and business knowledge to colleagues while mentoring junior staff on emerging technologies and architectural patterns.
* Influence positive changes and improvements through exceptional technical leadership skills.

Skills & Qualifications

* Experience in creating data strategies and roadmaps to enhance business processes and achieve business goals.
* Deep knowledge on data governance frameworks such as DAMA-DMBOK and DCAM.
* Expert in designing and building large-scale enterprise data analytics, data management, and security solutions with high availability.
* Extensive experience in Web application development (JAVA, Python, Angular, etc.).
* Extensive knowledge and experience in some of the following IT architectures: End-to-end AWS data analytics architecture, Data catalog, Synthetic data, and Data pipelines.
* Expertise in data management tools like NoSQL, Data Lake Formation, AWS DMS, RedShift, Lambda, AWS Glue, EMR, Kinesis, QuickSight, Qlik, etc.
* Expertise in MLOPS in terms of establishing life cycle management for managing ML models and enhancements.
* Expertise in leveraging AI technologies such as ML/NLP and GPT-4 to perform predictive analytics.
* Expertise in automating data infrastructure configurations using infrastructure as code (IaC) such as AWS cloud formation templates and AWS glue pipelines.
* Excellent oral, written, and presentation skills
* Good interpersonal skills and demonstrated success working with cross-functional teams

Education

* Bachelor's Degree
* AWS Solutions Architect Associate certification is a must