Vaga de SR Data Engineer
1 vaga: | Publicada em 03/04
- A Combinar
Sobre a vaga
Location:
Brazil
Job Mode:
Full-time
Work Mode:
Work from home
Responsibilities and Duties
Desire to work at high level with stakeholders to devise, understand and
communicate clearly requirements and architecture design for data platforms in an
efficient manner;
Large Experience with architecture, governance, security, design, business mapping
and understanding, performance and tuning for data lake, data warehouse and other
data storage systems and transformation;
Experience with talking with customers and stakeholders and extracting business
and technical requirements in high and low level;
Strong knowledge of Data frameworks and tools:
Hadoop (YARN, HDFS), Hive, Spark, Kafka, Pentaho, Airflow, Iceberg, parquet, AWS
data tools (Glue, EMR, Athena, S3;
Experience manipulating data using SQL, NoSQL and unstructured data sources,
including metadata;
Strong knowledge of ETL frameworks and workflow processes (data ingestion, clean
up and preparation);
Strong knowledge of Python and Pyspark code development;
Experience in creating solutions in AWS.
Highly Desirable Skills
Experience with Java;
Large experience with data modeling, data design and ETL optimization;
System administration experience on Linux platforms;
Financial and/or banking marketing knowledge is a plus.
Additional Skills
Experience with Snowflake and Data migration tools (DMS, metano, Fivetran,
Airbyte);
Machine learning algorithms and workflow;
Pipeline and workflow orchestration (Oozie, Luigi, Airflow);
Experience with Kubernetes;
Knowledge of DataOps and data pipeline monitoring.
About Encora
Encora is the preferred digital engineering and modernization partner of some of
the worlds leading enterprises and digital native companies. With over 9,000
experts in 47+ offices and innovation labs worldwide, Encoras technology
practices include Product Engineering & Development, Cloud Services, Quality
Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and
AI & LLM Engineering.
At Encora, we hire professionals based solely on their skills and qualifications,
and do not discriminate based on age, disability, religion, gender, sexual
orientation, socioeconomic status, or nationality.