Job Description
We are looking for a Technical Lead who can work with data engineering teams and our customers to design innovative solutions to enterprise problems like big data processing, implementing use cases on data lakes/data warehouses, and migrating data platforms to the cloud. The Technical Lead will engage in designing data-driven applications for our customers.
Responsibilities:
- Creating architectural roadmaps for data platforms, databases, big data applications, and data warehouses.
- Define data integration flows (ETL, ELT, stream and batch processing, event processing, etc.)
- Work with data engineers to improve the scalability and efficiency of data platforms.
- Lead in implementing architectural and design frameworks across data platforms and software teams.
- Drive adoption of new tools and techniques for big data platforms.
- Creation of POCs (proof of concept) and validate the feasibility of new technologies.
Skills Required
- 10+ years of experience in software development, with 5+ years of experience working in a complex data platform environment.
- Hands-on experience in designing data pipelines and making improvements to existing pipeline architectures for large organizations.
- Experience with cloud technologies, such as AWS, Microsoft Azure, or GCP.
- Deep knowledge of big data tools like Hadoop, Spark, Hive, Cassandra, HBase, etc
- Technologies like Kafka/Active MQ/ Rabbit MQ/ Zero MQ/ Rocket MQ are preferred.
- Experience with CI (Continuous Integration) and CD (Continuous Delivery).
- Experience using OLTP / OLAP / Graph / dimensional / NoSQL databases.
- Hands-on experience with RDBMS systems like PostgreSQL, MySQL, and Oracle.
- Expertise in design/coding using languages like Java, Python, or Scala.
- Expertise in data modeling (conceptual, logical, and physical models in relational and dimensional)
- Excellent presentation and communication skills.
- Strong analytical problem-solving skills.
- Excellent interpersonal skills, working in collaboration with onshore and offshore teams.
- Adaptive for change and implementing new technologies & processes.
- Should be proactive with a zeal to learn and have an inquisitive attitude.
- Demonstrate leadership, getting the team together, and team-building capabilities.
