Training models to identify GUI Widgets.

• clone repo
  • git clone git@github.com:thomasdeanwhite/GUIdance.git
• Fetch weights using GitLFS: git lfs pull or download them from this repo
• unzip weights zip file
• Rename gui-tester/src/main/python/gui_interaction/config.py.BACK to config.py
• Change gui-tester/src/main/python/gui_interaction/config.py
  • data_dir and output_dir to directory of training input data and desired output directory

To visualise bounding boxes, model_plot.py can be used:

gui-tester/src/main/python/gui_interaction/model_plot.py [path to image]

e.g.

python gui-tester/src/main/python/gui_interaction/model_plot.py /home/user/img.png

Ensure that the model weights are in the folder weights in the directory you are running the python script from.