Experience
Posted on Dec 6, 2023
« Curriculum Vitae
Research
Structure-Rich Text Benchmark for Knowledge Inference Evaluation
- April – August 2023
- Research Assistant, studied various structured texts and developed an LLM benchmark
- Shanghai Key Laboratory of Data Science
- Conducted in-depth research on 8 structured texts and devised 29 tasks, creating a comprehensive benchmark of 5,800 QAs to evaluate the structure-based inference ability of Large Language Models (LLMs)
Xiezhi: An Ever-Updating Benchmark for Holistic Domain Knowledge Evaluation (AAAI24 Accepted)
- April 2023
- Co-author, researched diverse data source and contributed to the benchmark
- Shanghai Key Laboratory of Data Science
- Collected 60,000 questions from various domains and transformed into a desired format for building a benchmark of 28,000 QAs
Towards Evaluating Knowledge Graph Value based on Corpus
- September 2022
- Research Assistant, an evaluation on KG values using QAs derived from corpus
- Shanghai Key Laboratory of Data Science
- Conducted an investigation into Named Entity Recognition and Word Alignment methods to support Knowledge Graph evaluation, involving the reproduction and modification of existing research works in a collaborative, fast-paced environment
Internship
Sunde Info Inc.
- June – July 2021
- Software Developer Intern, developed query backend of large corpus for an exhibition website
- University Avenue, Shanghai, China
- Developed responsive query (latency less than 100ms for 20000 documents) using Elasticsearch with customized words segmentation
- Reformatted 15,000 records using reusable shell scripts for integration into a database containing around 20,000 structured documents
- Collaborated with a 10-member Agile team to deliver new features, fix bugs, and enhance performance through bi-weekly meetings
Teaching
TA at Intro to Distributed System
- February – June 2023
- Teaching Assistant, an introduction to distributed system for undergraduates
- Software School, Fudan University, Shanghai, China
- Crafted monthly assignments and developed instructional code samples in a formal, technical, and comprehensible manner, covering topics including HDFS, HBase, Raft, and other distributed systems
TA at Programming in C for Freshmen
- : September 2022 – January 2023
- Teaching Assistant, a C programming language introduction course
- Software School, Fudan University, Shanghai, China
- Assisted in debugging students’ code for weekly assignments and the final project, and conducted project interviews in a class of 42 students, in collaboration with another TA
- Authored readable and well-structured formal tutorials in LaTeX, along with stub code for weekly assignments, to test students’ familiarity with the C programming language
- Collaboratively designed the midterm and final projects with other assistants, which included detailed instructions for freshman students. The projects required developing the best strategy using Genetic Algorithms for a 2D game, as described in Melanie Mitchell’s book Complexity: A Guided Tour