# vtk-examples Repository Scraping

**URL:** https://discourse.vtk.org/t/vtk-examples-repository-scraping/6730
**Category:** Development
**Created:** [September 30, 2021, 7:12am UTC](https://discourse.vtk.org/t/vtk-examples-repository-scraping/6730 "2021-09-30T07:12:55Z")
**Posts on this page:** 1
**Page:** 1

<div class="post-metadata">

### Author: ![amaclean](https://discourse.vtk.org/user_avatar/discourse.vtk.org/amaclean/32/224_2.png) [@amaclean](https://discourse.vtk.org/u/amaclean)
#### Post date: [September 30, 2021, 7:12am UTC](https://discourse.vtk.org/t/vtk-examples-repository-scraping/6730/1 "2021-09-30T07:12:55Z")

</div>

I have just completed a major rewrite of ScrapeRepo.py. This script generates all the markdown files for the web.

Please let me know it you see any issues on the web pages e.g missing/bad links or missing images.

Here is a summary of the last run, `Doxygen` refers to links to online documentation and `Thumbnails` refers to links to images. The figures here are the same as for the old version, except for Python where two extra files were picked up.

```bash
ScrapeRepo Summary
  C++ examples: 1058
  CSharp examples: 121
  Python examples: 384
  Java examples: 233
  Total examples: 1796
  Tarballs: 1058
  Doxygen added: 2432
  Thumbnails added: 1947
  Test Image Cache hits: 1613
  Test Image Cache misses: 0
  VTK Modules Cache hits: 1058
  VTK Modules Cache misses: 0
Time taken: 2.655s

```

Please see [!228](https://gitlab.kitware.com/vtk/vtk-examples/-/merge_requests/228) for more details.