Software Engineer II (AI Integration)

The AI Engineer is responsible for designing, building, and deploying AI/ML solutions that enhance business processes, improve decision-making, and enable automation. This role combines software engineering, data science, and machine learning expertise to develop scalable AI systems in production environments.

Key Responsibilities

• 3-5 years total experience
• Develop end-to-end pipelines including data preprocessing, feature engineering, validation, and deployment.
• Fine-tune LLM-based applications using frameworks like LangChain, LangSmith, or OpenAI APIs.
• Deploy models into production using CI/CD pipeline.
• Build scalable microservices or APIs to serve ML models in real time.
• Implement monitoring for model drift, performance, and reliability.
• Collaborate with data engineering teams to define data requirements.
• Work with structured and unstructured datasets using Python, SQL, Spark, Pandas, etc.
• Ensure data quality, governance, and security
• Evaluate new AI frameworks, tools, and techniques.
• Prototype solutions and run experiments to explore feasibility.
• Stay up to date with advancements in LLMs, vector embeddings, multimodal AI, and model compression/optimization.

• Work with product managers and business teams to translate business problems into AI solutions.
• Partner with cloud engineers and DevOps teams for scalable deployment.
• Communicate complex technical concepts to non-technical stakeholders.

Required Skills & Qualifications

• Strong programming skills in Python (NumPy, Pandas, Scikit-learn, PyTorch or TensorFlow).
• Experience with LLMs, NLP, or deep learning.
• Knowledge of MLOps tools: MLflow, Kubeflow, Airflow, Docker, Kubernetes.
• Experience with cloud platforms (AWS/GCP/Azure) and model deployment.
• Understanding of data structures, algorithms, and software engineering best practices.
• Problem-solving and analytical thinking.
• Ability to design scalable, maintainable systems.
• Strong communication and documentation skills.
• Collaboration in agile or cross-functional team environments.

Preferred Qualifications (Nice to Have)

• Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or related field.
• Experience building large-scale AI systems or enterprise-grade ML applications.
• Experience working in regulated industries.
• Knowledge of vector databases, RAG systems, or generative AI applications.

Who We Are:

TD is one of the world's leading global financial institutions and is the fifth largest bank in North America by branches/stores. Every day, we strive to make every interaction, product, and experience remarkably human and refreshingly simple for over 27 million households and businesses in Canada, the United States and around the world...