The Big Data Architect will be responsible for the successful delivery of Big Data and Data Warehouse solutions and related components.
Principais responsabilidades
*Design, develop, and maintain a data warehouse and analytics architecture to meet business analysis and reporting needs, where scale and reliability of a modern distributed system is at heart
*Develop, test, improve and maintain ETL jobs and data flow scripts to fill data warehouse from production databases and various external data sources
*Manage data quality and develop processes to ensure the highest standards
*Build fast and scalable data flows between databases, data warehouse, and cloud platforms, ensuring high availability and reliability of the solution
*Propose solutions to optimize and scale data warehouse and data processing infrastructure
*Contribute to the development of data analytical and self-learning applications
Perfil desejado
*Knowledge of data integration, data modeling, normalization and design of data warehouse
*Advanced knowledge of ETL development and optimization
*Experience with ETL with microservices, not a Monolith
*Experience with real-time and stream processing
*Experience in working with various data sources Web Services, application API, XML, Relational Databases, Document Oriented NoSQL databases, etc.
*Good understanding of Big Data technologies (especially open source like Apache Flink, Apache Spark, Apache Druid, Kafka, Kafka-Connect
*Experience with big data storage and query engines
*Production experience with Amazon AWS especially for BigData purposes.
*Experience with cloud infrastructure providers High integrity and credibility, can-do attitude Excellent communicator in English.
Benefícios adicionais
A great place to work, having a sense of cooperation between the team. It's also on the table a solid career path, new opportunities to grow and be challenged. Our client also offers great benefits and a rewarding experience.