Big Data Software Engineer [Lead]

Come join a project at an industry-leading financial intelligence and analytics powerhouse!
Our customer is a renowned financial information and analytics company that provides essential intelligence to businesses, governments, and individuals worldwide. The client offers a wide range of services, including credit ratings, market intelligence, data analysis, and investment research. A company is best known for its credit ratings division which assesses the creditworthiness of companies and governments.
Join the project and be at the forefront of shaping the future of financial information and analytics!
Responsibilities
Drive the development of the data platform
Oversee a team of developers and QAs
Take part in architecture decisions and implementation
Design and develop solutions utilizing Integration Best Practices
Manage complex data workflows
Provide day-to-day support and technical expertise to other engineers
Work across the full software development cycle
Help improve end-to-end development process, from data collection tools to deployment in a production environment
Handle direct communication with the customer
Requirements
Data Architecture Modeling experience
Strong Python development skills
Expertise in SQL
Strong understanding of Data Pipeline and Data Storage tooling (AWS S3, AWS Glue, Apache AirFlow, Apache Kafka, Apache Spark/PySpark, CloudFormation/Terraform, Delta Lake)
Understanding of RESTFUL APIs and web technologies
Familiarity with Micro-service architecture
Experience with the full development lifecycle
Experience with AWS cloud platform
Solid understanding of containers and orchestration tools (Docker, CI/CD)
English level of minimum B2 (Upper-Intermediate) for effective communication