Tutorial
  • Research Skill Bootcamp
    • Overview
    • Introduction to Research
    • Literature Review
    • Latex, Overleaf and Template
    • Latex, use TikZ to draw diagram
    • Introduction to Pytorch
    • Introduction to Neural Networks, MLP, CNN, RNN, Transformer
    • Problem Formulation and Experiment Design
    • Before Vision Becomes Reality
  • AI Engineer Bootcamp
    • Poster
    • Introduction
    • Development Environment Setup
    • Docker
    • Git, GitHub and Agile
    • Introduction to RAG
    • Full Stack Intro, Demo and Setup
    • Python Package Development
    • Databases
    • React
    • Django
    • GraphQL and Hasura
    • Authentication and Authorization
    • Deploy and CI/CD
    • Project Demo
    • External Resources
    • Knowledge Graph and GraphRAG
  • Dev Setup
    • How to install Docker
    • Docker 101
  • GPU Resources
    • HPC 101
    • Kaya
      • Demo project
      • Interactively use Kaya with JetBrains Gateway
      • Battle notes
      • Run experiment on Multiple GPU in Kaya
    • DUG
      • DUG HPC FastX connection Guide for Linux
  • Background Knowledge
    • Public Available LLM
      • Self-Hosted LLM
      • Quantization demo
      • Public Open LLM API
Powered by GitBook
On this page
  • Summary
  • Schedules and Contents
  • Contents

Research Skill Bootcamp

NextOverview

Last updated 29 days ago

Summary

To assist our new honours project students and new PhD students to get up to speed with basic research skills, we are planning to continue last year's wonderful AI Bootcamp delivered by Pascal to a new series of bootcamp workshops. This Research Skill Bootcamp, will cover content ranging from power-use of Overleaf for proposal and slides preparation, literature review dos and don'ts, effective communication through diagrams and mathematical equations, use of LLMs for smoothing up and improving your writing, to a quick run-through sequential modelling (MLP->1DCNN->RNN->LSTM->Transformers->Diffusion Models->Mamba).

These workshops will be more interactive and assistive in nature. Please bring your writing, presentation and research tasks to the bootcamp for feedback from your peers, more experienced PhD students, and academic staff. This is a rare occasion where we can all share our experience and pain points and work together to solve them.

Attendance is optional, but I strongly encourage all honours project students and new PhDs to attend. Staff feel free to attend if you have spare time and would like to offer a session or two that you see important for research skill building. We will set up Teams channels and Web-accessible tutorials to capture all the materials developed through these sessions for future re-use.

More details on the web pages and the content schedule will follow. Please also feel free to forward this if you see other students might benefit and for anyone that I might have missed. We currently plan to host it in a workshop room in Math G19, but will let you know if location has to change later.

Schedules and Contents

The Research Skill Bootcamp will run according to the following schedule:

  • When: Starting from 2025.03.06, every Thursday afternoon from 2pm to 4pm

  • Duration: Throughout the entire semester

  • Format: Interactive workshops, progressing from basic to advanced skills

  • Location: UWA MATH G19, link:

  • Team: UWA NLP-TLP Group (Sirui Li, Pascal Sun, Daochang Liu, Jichunyang Li, Wei Liu)

Contents

  • Topics will vary from the toolsets, writing, etc. E.g.

  • How to use overleaf for writing and presentation? we also will provide latex templates.

  • How to do literate search and literature review? What questions to ask? Tools like connectedpaper.

  • How to design experiments and do research execrise?

  • How to draw diagrams? Tools like: draw.io, Canva, Figma, PPT, Miro, tikz

  • How to manage bib and literature papers? Endnotes or Mendley.

  • How to mathmatically formalize the research questions?

Module
Topic
Key Components
Video/Slides

1. Research Pipeline Overview

Introduction to Research Process

• Research lifecycle from problem to publication • Different research paradigms • Understanding the academic ecosystem

2. Writing Tools

LaTeX, Overleaf and Reference Management

• Document templates and structure • Formula typesetting • Table and figure creation • Collaborative writing features • Bib tools and styles

3. Literature Review

Finding and Analyzing Existing Work

• Effective search strategies • Tools: Connected Papers, Semantic Scholar, Google Scholar • Critical reading and note-taking techniques • Identifying research gaps

4. Problem Formulation

Defining Your Research

• Formulating research questions • Mathematical formalization of problems • Hypothesis development • Scope definition

5. Experiment Design

Planning Your Investigation

• Selecting appropriate methodologies • Experimental design principles • Ethics considerations and approvals • Research validity and reliability

6. Data Management

Handling Research Data

• Data collection methods • Cleaning and preprocessing techniques • Storage and organization best practices • Data documentation and metadata

7. Visualization

Creating Effective Diagrams

• Tool selection (draw.io, Canva, Figma, TikZ) • Diagram design principles • Data visualization best practices • Creating publication-quality figures

8. Analysis Methods

Data Analysis Frameworks

• Statistical analysis techniques • Selecting appropriate methods

• Ablation Study • Tools and software • Results interpretation

9. Advanced Modeling

Deep Learning Models

• Neural network foundations (MLP) • Sequence models (CNN, RNN, LSTM) • Transformer architectures • Recent advances (Diffusion Models, Mamba)

10. Academic Writing

Creating Research Papers

• Paper structure and organization • Writing clear abstracts and introductions • Results presentation • Responding to reviewer feedback

11. Research Communication

Presenting Your Work

• Conference presentation skills • Poster design and delivery • Research "elevator pitch" • Slide design principles

  1. Guest Talk

Previous. Student Sharing

  • Varun from Google Gemni Team

Schedule is subject to changes based on feedback.


Further reading list:

https://karpathy.github.io/2016/09/07/phd/
http://linyun.info/phd-grinding.pdf
Introduction
Research Overview
Latex, Overleaf and Template
Literature review
Problem and Experiment
Problem and Experiment
How to use TikZ?
Introduction to Pytorch
NN, MLP, LSTM, RNN, Transformer
10 years in Google Deep Brain/DeepMind/Gemni
https://link.mazemap.com/8CKcNRc8