Skip to content

Commit

Permalink
new
Browse files Browse the repository at this point in the history
  • Loading branch information
@AtlasWang
AtlasWang committed Apr 2, 2024
1 parent b5615b7 commit 6967e21
Show file tree
Hide file tree
Showing 7 changed files with 8 additions and 4 deletions.
Binary file modified Spring24/Lecture 16+17.pdf
View file
Binary file not shown.
Binary file added Spring24/Lecture 18.pdf
View file
Binary file not shown.
3 changes: 2 additions & 1 deletion group.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -433,6 +433,7 @@ <h2>Visiting Scholars</h2>
<!-- <div class="row justify-content-md-left" style="margin-top: 0px"> -->
<ul>
<li> <a href="https://simoneangarano.github.io/">Simone Angarano</a>, Ph.D. student in ML at Politecnico di Torino, Italy, Aug 2023 - present </li>
<li> <a href="https://scholar.google.com/citations?user=Ihn-OugAAAAJ&hl=en">Gabriel Jacob Perin</a>, undergraduate student in CS at University of São Paulo, Brazil, Apr 2024 - present </li>
</ul>
<!-- </div> -->
</div>
Expand All @@ -459,6 +460,7 @@ <h2>Undergraduate Students</h2>
<li> Henry Castillo, CS@UT Austin, Aug 2022 - present </li>
<li> Jinze Zhao, ECE@UT Austin, Aug 2023 - present </li>
<li> Yihan Xi, CS@UT Austin, Aug 2023 - present </li>
<li> Jonathan Liu, CS@UT Austin, Dec 2023 - present </li>
</ul>
<!-- </div> -->
</div>
Expand Down Expand Up @@ -684,7 +686,6 @@ <h2>Alumni</h2>
<li> Yee Yang Tee, Ph.D. student, EEE@Nanyang Technological University, Singapore, visitng VITA during Aug 2022 - Jan 2023 </li>
<li> Artur André Oiveira, Ph.D. student, CS@University of São Paulo, Brazil, visitng VITA during Dec 2021 - May 2022 </li>
<li> Shuai Yang, Ph.D. student, CS@Peking University, visitng VITA during Sep 2018 - Sep 2019</li>
<li> Liqiang Liu, Ph.D. student, Chinese Academy of Sciences, visitng VITA during May 2018 - May 2019</li>

<br>
<li>Saebyeol Shin, undergraduate, Sungkyunkwan University, South Korea, Fall 2023 [remote]</li>
Expand Down
3 changes: 2 additions & 1 deletion index.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -171,7 +171,7 @@ <h2>News</h2>
<b style="color:rgb(68, 68, 68)"><i>If you are here to seek "TL;DR"...</i></b>
<ul style="margin-bottom:5px">
<li><b style="color:rgb(71, 71, 71)">Question</b>: what should I read, if I just want to have a very quick glance at what VITA is currently digging on? </li>
<li><b style="color:rgb(71, 71, 71)">Short Answer</b>: we pick five papers that represent our recent flavors as "chef's choice". The list will change over time: <a href="https://arxiv.org/abs/2306.14048">[Heavy-Hitter Oracle, NeurIPS 2023]</a>, <a href="https://arxiv.org/abs/2306.03805">[Essential Sparsity, NeurIPS 2023]</a> , <a href="https://openaccess.thecvf.com/content/CVPR2023/papers/Xu_NeuralLift-360_Lifting_an_In-the-Wild_2D_Photo_to_a_3D_Object_CVPR_2023_paper.pdf">[NeuralLift-360, CVPR 2023]</a> , <a href="https://openreview.net/forum?id=cDYRS5iZ16f">[Learning to Grow LLMs, ICLR 2023]</a>, <a href="https://jmlr.org/papers/volume23/21-0308/21-0308.pdf">[Learning to Optimize, JMLR 2022]</a>
<li><b style="color:rgb(71, 71, 71)">Short Answer</b>: we pick five papers that represent our recent flavors as "chef's choice". The list will change over time: <a href="https://arxiv.org/pdf/2403.03507.pdfs">[GaLore, arXiv 2024]</a>, <a href="https://arxiv.org/abs/2306.14048">[Heavy-Hitter Oracle, NeurIPS 2023]</a>, <a href="https://openaccess.thecvf.com/content/CVPR2023/papers/Xu_NeuralLift-360_Lifting_an_In-the-Wild_2D_Photo_to_a_3D_Object_CVPR_2023_paper.pdf">[NeuralLift-360, CVPR 2023]</a> , <a href="https://openreview.net/forum?id=cDYRS5iZ16f">[Learning to Grow LLMs, ICLR 2023]</a>, <a href="https://jmlr.org/papers/volume23/21-0308/21-0308.pdf">[Learning to Optimize, JMLR 2022]</a>
</li>
<li><b style="color:rgb(71, 71, 71)">Long Answer</b>: Please refer to our (still brief) <a href="research.html">Research Agenda</a>
</li>
Expand All @@ -182,6 +182,7 @@ <h2>News</h2>

<b style="color:rgb(68, 68, 68)">[Mar. 2024]</b>
<ul style="margin-bottom:5px">
<li> 1 IEEE Trans. PAMI (zero-shot NAS) accepted</li>
<li> 1 WWW'24 (dynamic graph training) accepted</li>
</ul>

Expand Down
2 changes: 2 additions & 0 deletions publication.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -159,6 +159,8 @@ <h2>Journal Paper</h2>
<div class="trend-entry d-flex">
<div class="trend-contents">
<ul>
<li> G. Li, D. Hoang*, K. Bhardwaj, M. Lin, Z. Wang, and R. Marculescu<br> <b style="color:rgb(71, 71, 71)">“Zero-Shot Neural Architecture Search: Challenges, Solutions, and Opportunities”</b><br> IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024. <a href="https://arxiv.org/abs/2307.01998">[Paper]</a> <a href="https://github.com/SLDGroup/survey-zero-shot-nas">[Code]</a></li>

<li> E. Oikonomou, G. Holste*, N. Yuan, A. Coppi, R. McNamara, N. Haynes, A. Vora, E. Velazquez, F. Li, V. Menon, S. Kapadia, T. Gill, G. Nadkarni, H. Krumholz, Z. Wang, D. Ouyang, and R. Khera<br> <b style="color:rgb(71, 71, 71)">“A Multimodality Video-Based AI Biomarker for Aortic Stenosis Development and Progression”</b><br> JAMA Cardiology, 2024. <a href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10557799/">[Paper]</a> [Code]</li>
<li> W. Chen*, X. Gong*, J. Wu*, Y. Wei, H. Shi, Z. Yan, Y. Yang, and Z. Wang<br> <b style="color:rgb(71, 71, 71)">“Understanding and Accelerating Neural Architecture Search with Training-Free and Theory-Grounded Metrics”</b><br> IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023. <a href="https://arxiv.org/abs/2108.11939">[Paper]</a> <a href="https://github.com/VITA-Group/TEGNAS">[Code]</a></li>
<li> Z. Jiang*, G. Zheng, Y. Cheng, A. Awadallah, and Z. Wang<br> <b style="color:rgb(71, 71, 71)">“CR-MoE: Consistent Routed Mixture-of-Experts for Scaling Contrastive Learning”</b><br>Transactions on Machine Learning Research (TMLR), 2023. <a href="https://openreview.net/forum?id=qKIvn9xL1R">[Paper]</a> <a href="https://github.com/VITA-Group/CRMoE">[Code]</a></li>
Expand Down
2 changes: 1 addition & 1 deletion research.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -184,9 +184,9 @@ <h4>Theme 1: Efficient and Scalable Learning through Intrinsic Low Dimensionalit
</p>

<b style="color:rgb(68, 68, 68)"><i>Selected Notable Works:</i></b>
<li>J. Zhao, Z. Zhang*, B. Chen, Z. Wang, A. Anandkumar, and Y. Tian, <b style="color:rgb(71, 71, 71)">"GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection”</b>, arXiv:2403.03507, 2024. <a href="https://arxiv.org/abs/2403.03507">[Paper]</a> <a href="https://github.com/jiaweizzhao/GaLore">[Code] </a> </li>
<li>A. Jaiswal*, S. Liu*, T. Chen*, Z Wang, <b style="color:rgb(71, 71, 71)">"The Emergence of Essential Sparsity in Large Pre-trained Models: The Weights that Matter”</b>, Advances in Neural Information Processing Systems (NeurIPS), 2023. <a href="https://arxiv.org/abs/2306.03805">[Paper]</a> <a href="https://github.com/VITA-Group/essential_sparsity">[Code] </a> </li>
<li>Z. Zhang*, Y. Sheng, T. Zhou, T. Chen*, L. Zheng, R. Cai*, Z. Song, Y. Tian, C. Ré, C. Barrett, Z. Wang, and B. Chen, <b style="color:rgb(71, 71, 71)">"H<sub>2</sub>O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models”</b>, Advances in Neural Information Processing Systems (NeurIPS), 2023. <a href="https://arxiv.org/abs//2306.14048">[Paper]</a> <a href="https://github.com/FMInference/H2O">[Code] </a> </li>
<li>D. Hoang*, S. Liu*, R. Marculescu, and Z. Wang, <b style="color:rgb(71, 71, 71)">"Revisiting Pruning at Initialization Through the Lens of Ramanujan Graph”</b>, International Conference on Learning Representations (ICLR), 2023. (Oral) <a href="https://openreview.net/forum?id=uVcDssQff_">[Paper]</a> <a href="https://github.com/VITA-Group/ramanujan-on-pai">[Code] </a> </li>
<li>T. Chen*, Z. Zhang*, A. Jaiswal*, S. Liu*, and Z. Wang, <b style="color:rgb(71, 71, 71)">"Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers”</b>, International Conference on Learning Representations (ICLR), 2023. (Spotlight) <a href="https://openreview.net/forum?id=w1hwFUb_81">[Paper]</a> <a href="https://github.com/VITA-Group/Random-MoE-as-Dropout">[Code] </a> </li>
<li>T. Chen*, J. Frankle, S. Chang, S. Liu, Y. Zhang, Z. Wang, and M. Carbin, <b style="color:rgb(71, 71, 71)">“The Lottery Ticket Hypothesis for Pre-trained BERT Networks”</b>, Advances in Neural Information Processing Systems (NeurIPS), 2020. <a href="https://proceedings.neurips.cc/paper_files/paper/2020/file/b6af2c9703f203a2794be03d443af2e3-Paper.pdf">[Paper]</a> <a href="https://github.com/VITA-Group/BERT-Tickets">[Code]</a></li>
<br>
Expand Down
2 changes: 1 addition & 1 deletion spring_24.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -301,7 +301,7 @@ <h2>Spring 24 - Introduction to Computer Vision</h2>
</div>

<div style="width:100%; margin-left: 0;" class="row">
<p><div class="column_1">4/04 Thursday</div> <div class="column_2"> Image Classification: Bag-of-Words <a href="">[Slides 4/04]</a> </div></p>
<p><div class="column_1">4/04 Thursday</div> <div class="column_2"> Image Classification: Bag-of-Words <a href="Spring24/Lecture 18.pdf">[Slides 4/04]</a> </div></p>
</div>
<div style="width:100%; margin-left: 0;" class="row">
<p><div class="column_1">4/09 Tuesday</div> <div class="column_2"> Object Detection and Segmentation (1) </div></p>
Expand Down

0 comments on commit 6967e21

Please sign in to comment.