Brazil
Pavago
Grupo Data
Mid-Level Data Engineer – Big Data / Spark
Brazil
São Paulo, São Paulo, Brazil
PythonJavaSQL
Automatic translation. Check the original.
About the Opportunity
Mid-Level Data Engineer – Big Data / Spark
We are looking for a Mid-Level Data Engineer to work on the development, maintenance, and optimization of data processing solutions on the Client Contribution platform. The professional will be responsible for building scalable pipelines, ensuring data quality, and contributing to the evolution of the Big Data architecture in an agile environment driven by good engineering practices.
Responsibilities
- Develop, maintain, and optimize data processing solutions;
- Design and develop ETL and data transformation processes;
- Implement and maintain pipelines using Apache Spark;
- Support data integration initiatives between different systems;
- Analyze and resolve data-related incidents;
- Ensure the quality, performance, and reliability of data solutions;
- Collaborate with multidisciplinary teams in an Agile environment.
Mandatory Requirements
- Minimum of 3 years of experience in Data Engineering and development;
- Solid knowledge of SQL, including:
- ANSI SQL;
- Hive SQL;
- Spark SQL;
- Experience with Apache Spark;
- Knowledge of at least one of the following languages:
- Scala;
- Python;
- Java;
- Experience with Big Data platforms, such as:
- Azure Databricks;
- Amazon EMR;
- Hive;
- Cloudera;
- or other Spark-based environments;
- Experience with Qlik Sense for report and dashboard development;
- Experience in Continuous Integration (CI) environments, DevOps, and agile methodologies;
- Knowledge of tools such as:
- Git;
- GitHub;
- SonarQube;
- Nexus;
- Ability to analyze requirements and work collaboratively;
- English level B2 or higher.
- Spanish level B2 or higher.
Preferred Qualifications
- Interest or experience in using Artificial Intelligence tools applied to Data Engineering;
- Knowledge in process automation using AI;
- Interest in using development assistants to increase productivity, code quality, and efficiency of analytical solutions.
Position Conditions
- 100% remote work;
- Future relocation to Portugal or Spain is mandatory if required due to project, company strategy, or legal requirements;
- While in Brazil, the work will be performed entirely remotely;
- Resumes must be submitted in English.
More opportunities with one profile
Want to be considered for more roles without repeating the whole process? Create your profile and be found by companies using Nort.
Create my profile