Shannon Phu

Work Experience

    Discord
    Senior Machine Learning Engineer | Applied ML
    May 2022 - Present
  • Led a team for the AI chat summaries project, driving the training and serving of a chat summarization LLM service scaled to 25M servers saving Discord $2M per year
  • Optimized LLMs using TensorRT-LLM and implemented efficient serving infrastructure for a 10x inference speed-up
  • Integrated AI chat summaries into a notification experience which drove 2M new conversation joins per month and increased long-term user communication
  • Established the framework for LLM training and serving workstreams within Discord and mentored other engineers on ML and LLM development
  • Implemented a recommendation system for the Discord server home feed. Developed candidate generation, model training, model serving, and data collection instrumentation
    Microsoft
    Applied Scientist | Bing Search
    Sept 2020 - May 2022
  • Trained click prediction models to rank carousels and entities for all named entities on Bing using gradient boosted trees
  • Performed large-scale clustering on BERT embeddings of 2M Wikipedia categories for category diversification
  • Applied variety of NLP techniques on knowledge graph and Wikipedia unstructured data to mine for relationships between named entities across 100 languages
  • Productionized carousel recommendations from a batch prediction pipeline using PySpark, Databricks, and Azure Data Factory
    • Machine Learning Engineer | Knowledge Graph AI
    Sept 2018 - Sept 2020
  • Shipped named entity engagement classification model trained using 100M Bing user search histories and established model evaluation metrics
  • Implemented large-scale knowledge graph feature mining for concept interest classification models
  • Productionized retraining and batch prediction pipelines to generate daily interest predictions on PySpark, Databricks, and Azure Data Factory
  • Developed content-based movie recommendation system for personalized movie recommendations on Bing search engine
    Microsoft
    Software Engineering Intern | Seeing AI
    June 2017 - Sept 2017
  • Developed real-time currency recognition for Seeing AI ("talking camera for the blind") using OpenCV
  • Implemented evaluation pipeline for evaluating currency recognition model performance and precision
  • Deployed pipeline to ship US and 8+ international currency models
    Uber
    Software Engineering Intern | Maps Services
    April 2017 - June 2017
  • Mined ride logs for inefficient rider pick up trends and improved pick-up algorithm to factor driver travel direction and optimal side of street
  • Developed Hadoop data pipeline to process and store pick-up location data to Cassandra cluster and built API service for maps engine to consume
    Microsoft
    Software Engineering Intern | Bing
    June 2016 - Sept 2016
  • Developed "Events to Watch" module in Bing Olympics experience that showed daily top matches of interest
  • Dispatched calls to fetch data, update data stores, and render C# UX components with fresh data for every market
    Morning Sign Out
    iOS Developer
    Aug 2015 - July 2017
  • Led development and app store release of advanced mental health diagnostic iOS application using Objective-C and Firebase
  • Developed mobile platform for browsing, reading, and subscribing to medical news articles and developed social media analytics tools for tracking user engagement
    The Daily Bruin
    Web Developer
    April 2015 - April 2017
  • Built static webpage generator for authors to dynamically create a responsive website for their articles
  • Developed responsive websites for short and long term news stories
  • Reconstructed new dailybruin.com photo gallery section with suggested galleries feature and redesigned UI