Enterprise Data Management and Analytics (EDMA) is a specialized division of Global Technology Services (GTS) and is accountable for the operation and delivery of the Enterprise Data Platform and Advanced Analytics Platform. This team works closely with TMX’s emerging new technologies (e.g. AWS Cloud, zeppelin notebook) for the analytics platform.
The architecture of TMX’s Big data, data warehouse and analytical platform is backed by a collection of modern technologies and the successful applicant will demonstrate a keen understanding, knowledge and experience in similar technology sets. The candidate should also have a history of hands-on technical know-how, a critical thinking approach to problem-solving, a sense of urgency and commercial acumen regarding delivery, and exhibit the initiative to identify challenges and solutions independently.
Primary responsibility for this role is to learn the architecture and design of the Hadoop based Enterprise Data Platform (TMX Data lake). The responsibilities will entail looking into onboarding/implementing new data sources into the data lake and provision data for downstream systems from Data Lake. This role will also be responsible to improve the automation of key processes supporting best practices to support DevOps practices used to support the Data Lake. This role will report into the Senior Manager of Enterprise Data Delivery.
On-board new data into the Data Lake
Review Java and Python application code for existing and new workflows and implement improvements
Application development of analytics to help analytics team build insights to support customer and business requests
Build data visualizations which are appealing and simple to both navigate and comprehend for end-users
Experience in Python, Java
Knowledge of various DBMS systems including NoSQL architectures and design principles.
Good understanding of AWS cloud technology and hadoop implementation on AWS including S3, EC2 and EMR
Hive and Hadoop experience
Experience with development using Agile methodologies
Excellent interpersonal and communication skills
Be a strategic thinker with excellent analytical and problem solving skills
Nice to have skills:
Previous experience in the financial and/or securities industry
Experience designing a technology stack for machine learning is an asset
Experience in the configuration of YARN, MapReduce for performance, security is an asset
Experience in Zeppelin Notebook, Ranger, Scala