--- license: mit pipeline_tag: object-detection --- # AI-Generated Lecture Slides for Improving Slide Element Detection and Retrieval This repository contains the `SynLecSlideGen` pipeline and resources from the paper [AI-Generated Lecture Slides for Improving Slide Element Detection and Retrieval](https://huggingface.co/papers/2506.23605). `SynLecSlideGen` is a large language model (LLM)-guided synthetic lecture slide generation pipeline that produces high-quality, coherent, and realistic slides. These synthetic slides are designed to include automated annotations for tasks such as **Slide Element Detection** and Text Query-based Slide Retrieval, which can help compensate for limited labeled real-world data. Project page: [https://synslidegen.github.io/](https://synslidegen.github.io/) Code: [https://github.com/synslidegen/synslidegen_pipeline](https://github.com/synslidegen/synslidegen_pipeline) ## Abstract Lecture slide element detection and retrieval are key problems in slide understanding. Training effective models for these tasks often depends on extensive manual annotation. However, annotating large volumes of lecture slides for supervised training is labor intensive and requires domain expertise. To address this, we propose a large language model (LLM)-guided synthetic lecture slide generation pipeline, SynLecSlideGen, which produces high-quality, coherent and realistic slides. We also create an evaluation benchmark, namely RealSlide by manually annotating 1,050 real lecture slides. To assess the utility of our synthetic slides, we perform few-shot transfer learning on real data using models pre-trained on them. Experimental results show that few-shot transfer learning with pretraining on synthetic slides significantly improves performance compared to training only on real data. This demonstrates that synthetic data can effectively compensate for limited labeled lecture slides. The code and resources of our work are publicly available on our project website: this https URL . ## Sample Generated Slides for Object Detection (`SynDet`)
SynDet1 SynDet2 SynDet3
## Usage To use the `synslidegen` pipeline, first clone the repository and install dependencies: ```bash git clone https://github.com/synslidegen/synslidegen_pipeline cd synslidegen_pipeline python3 -m venv # Activate the virtual environment # On Linux/macOS: source /bin/activate # On Windows: \Scripts\activate.bat pip install -r requirements.txt ``` You can then modify the `code/config.py` file to adjust parameters such as `SUBJECT`, `BOOK`, `MAX_TOPIC`, `LLM_MODEL`, `TEMPERATURE`, etc. To generate synthetic presentation slides, run: ```powershell .\run_synslidegen.ps1 -py_path "\Custom\Python\Path" -env_path "\Custom\VirtualEnv\Path" ``` Generated slides will be saved in the `ppts/` folder. To generate automated annotations for **Slide Element Detection**, uncomment the relevant lines in `run_synslidegen.ps1` (these typically involve running `code/post_processing/pptx_to_png.py` and `code/post_processing/bbox_annotations.py`): ```python # python 'D:\Research_work\Experimentation_Results\py_pptx_code_gen_using_LLMs\pptGEN_CLEANED\code\post_processing\pptx_to_png.py' # python 'D:\Research_work\Experimentation_Results\py_pptx_code_gen_using_LLMs\pptGEN_CLEANED\code\post_processing\bbox_annotations.py' ``` *(Note: The original paths in the script might be absolute and specific to a development environment. Adjust as necessary if running in a different setup, or refer to the `code/post_processing` directory.)* For more detailed usage instructions on generating annotations for slide image retrieval or fine-tuning, please refer to the [official GitHub repository](https://github.com/synslidegen/synslidegen_pipeline). ## Citation If you find our work helpful, please cite our paper: ```bibtex @inproceedings{synslidegen, title={SynSlideGen: AI-Generated Lecture Slides for Improving Slide Element Detection and Retrieval}, author={Suyash Maniyar, Vishvesh Trivedi, Ajoy Mondal, Anand Mishra, C.V. Jawahar}, booktitle={ICDAR}, year={2025} } ```