Job Description
Salary: $80k-$120k
6 Month C2H
100% on-site in Houston
Data Analyst Engineer plays a hybrid role that bridges the gap between data engineering and data analysis. Their responsibilities typically involve designing, building, and maintaining data infrastructure while ensuring the data is usable, reliable, and insightful for analysis and decision-making.
Key Responsibilities:
- Data Pipeline Development :
- Build and maintain ETL/ELT pipelines to collect, transform, and store data.
- Ensure data flows efficiently from source systems (e.g., databases, APIs, SaaS platforms) to data warehouses, lakes, or marts.
- Data Integration and Modeling :
- Integrate data from multiple sources into unified schemas for reporting and analytics.
- Design and develop data models, including star and snowflake schemas, for fact and dimension tables.
- Create staging and transformation layers to ensure clean, organized data.
- Data Quality Assurance :
- Implement data validation rules and monitor data accuracy.
- Set up processes to identify and resolve data inconsistencies, duplicates, or missing information.
- Establish data governance practices to ensure proper access, security, and compliance.
- Collaboration with Teams :
- Work closely with data scientists, business analysts, and stakeholders to understand their needs.
- Provide datasets, create dashboards, and support advanced analytics use cases.
- Serve as a liaison between technical and non-technical teams.
- Performance Optimization :
- Optimize query performance and ensure efficient data retrieval for analysis.
- Use tools like indexing, partitioning, or caching to manage large datasets effectively.
- Reporting and Visualization :
- Create reports and dashboards for stakeholders, translating data into actionable insights.
- Utilize tools like Tableau, Power BI, or Looker alongside SQL to present results.
- Technology Evaluation and Implementation :
- Assess and implement new tools or technologies (e.g., dbt, Apache Spark, Airflow) to improve data workflows.
- Maintain familiarity with cloud platforms like AWS, Azure, or GCP for data storage and processing.
- Documentation and Training :
- Document processes, pipelines, and data models for transparency and maintainability.
- Train team members on how to access and interpret data
- Workflow Orchestration:
- Utilize Prefect for orchestrating and managing data workflows.
- Monitor and maintain workflows to ensure reliability and handle dependencies.
- Data Modeling & Transformation:
- Use DBT to model and transform data within Databricks, preparing it for analysis and reporting.
- Optimize data workflows for performance and scalability.
- API Integration:
- Implement integrations with various APIs to pull in data.
- Handle data processing, authentication, and error management for external data sources.
- Data Lake Management:
- Work with data lake architectures, including Delta Lake, to store and process large datasets efficiently.
- Implement best practices for data storage, access, and management within the data lake environment.
- Collaboration & Reporting Support:
- Collaborate with data analysts to understand data requirements and provide data in formats suitable for Power BI reports.
- Ensure data is delivered in a timely and usable manner for effective reporting.
- Data Quality & Performance:
- Implement best practices for data validation, quality assurance, and error handling within pipelines.
- Continuously improve data processing performance and efficiency.
Skills Required:
- Technical Skills :
- Proficient in SQL, Python for data manipulation and analysis.
- Experience with data engineering tools (e.g., dbt, Apache Airflow, Kafka).
- Familiar with cloud platforms and data warehouses (e.g., Snowflake, BigQuery, Databricks).
- Skilled in visualization tools (e.g., Power BI, Tableau, Looker) & data preparation for reporting
- hands on experience with Prefect for workflow orchestration and proficiency in building scalable data pipelines in Databricks.
- Expertise in DBT for data modeling and transformation.
- Knowledge of REST API integration and handling JSON/XML data.
- Familiar with data lake architectures, including Delta Lake is a must
- Analytical Skills :
- Strong problem-solving abilities to address complex data issues.
- Ability to translate business needs into data requirements and solutions.
- Soft Skills :
- Excellent communication to explain technical concepts to non-technical stakeholders.
- strong problem solving/attention to detail
- Collaboration to work across teams effectively.
- self starter, someone who doesn't need much direction(can work independently & in a team environment)
- Needs a finance background (needs to understand numbers as they work alongside finance & sales)
- Experience :
- Minimum 3 years of experience in data engineering, focusing on building and maintaining data pipelines.
- Experience with cloud platforms (e.g., Azure, AWS, GCP) and data warehousing solutions.
- Proven track record of working with complex data workflows and ensuring data quality.
Interview Process:
- 2 Rounds: 1st virtual, 2nd On-Site
Why choose Addison IT?
• Pay: We negotiate high salaries using U.S. Bureau of Labor Statistics
• Benefits & Bonuses: You are eligible for medical, dental, vision insurance benefits, 401K, and monetary bonuses
• Permanent Employment: Many of Addison’s job openings lead to potential permanent employment
• Connections: You connect directly with hiring managers from renowned organizations
• Options: You are presented multiple employment options near your home
• Professional Development: You are provided hiring process advice, resume revision, and employment term negotiation
Addison Group is an Equal Opportunity Employer. Addison Group provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, national origin, age, disability, genetic information, marital status, amnesty, or status as a covered veteran in accordance with applicable federal, state, and local laws. Addison Group complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities. Reasonable accommodation is available for qualified individuals with disabilities, upon request.
Job Tags
Permanent employment, Contract work, Local area, Remote job,