Playing Sekiro with Deep Reinforcement Learning

Jan 2021 – May 2021

  • Applied DQN to a 3D action game named Sekiro: Shadows Die Twice with TensorFlow
  • Conducted a flexible preprocessing method based on collected data, cleaned and structuralized data
  • Designed a Region of Interest Detection Algorithm, utilized Canny edge detector to quantify characters’ status
  • Adapted to other 3D video games by modularizing main functions and parameters

Powershell

Oct 2022 – Mar 2023

  • A new and multifunctional blister design for contact lenses supported by user study, modeling, and 3D printing
  • Won the Visitor’s Choice Award in Project Vision, a research project focusing on the recycling problems and solutions of contact lenses sponsored by CooperVision
  • With a well-designed inverted bottom where the lenses can be picked up easily by one single finger
  • Stackable to be conveniently stored after use and the stability which offers a less-slide standing than usual
  • Gamification of coupling multiple blisters with a crispy “Bling”

YISHUN (壹瞬)

Nov 2019 – Dec 2019

  • A Portrait Shoot And Social Network Service For University Students Based on WeChat Mini App
  • Developed a “quick and simple” type of social app (students only) with Tencent Cloud Service
  • Cumulated beneficial information about the pay-to-play mode of portrait shoot around students

Document Scanner

Apr 2019 – Jun 2019

  • Designed a desktop tool whose function is similar to Cam Scanner, applied Hough lines detector written in OpenCV to process detected words in each image, rotated the whole page into a correct direction
  • Used Qt to conduct a testing interface for users to upload/save the files and define thresholds

Word Image Retrieval with Bag of Visual Words

 Oct 2020 – Nov 2020

  • Aimed to retrieve images from a collection of images that are similar to a query image
  • Tried extracting features in 2 different ways, and made comparisons (HoG, SIFT/K-means)
  • Used TF-IDF, re-rank, and query expansion to increase the precision & recall of results