Commit Graph

77 Commits (2a15272ba391e8a37c31d2a1bcc1def07d2ad36a)

Author SHA1 Message Date
Matthew D. Scholefield cc84253cda Remove optimizer dependencies
They aren't even used for most scripts and cause lots of problems
2020-01-30 16:29:11 -06:00
Matthew D. Scholefield a37958f3f2 Add fixes identified by test cases 2019-11-01 01:16:21 -05:00
Matthew D. Scholefield 4cec9b0767 Overhaul of how scripts are written to allow programmatic access
This introduces a way for scripts to be easily called from within Python with command line arguments as function parameters
To support this, prettyparse has been upgraded to the latest version
2019-11-01 00:03:44 -05:00
Matthew D. Scholefield e1211d0af0 Fix Python 3.4 compatibility with precise-train-sampled 2019-04-15 16:21:58 +00:00
Matthew D. Scholefield 302ae48d60 Fix precise-train-optimize on Python 3.4 2019-04-15 15:50:21 +00:00
Matthew D. Scholefield 116f596292 Remove variable tagger
Not useful. Was only created as an experiment and included accidentally
2019-04-10 05:11:35 -05:00
Matthew D. Scholefield 06430cd24d Add --freeze-till training parameter for transfer learning
For example, --freeze-till -2 will freeze layers[0:-2]
2019-04-09 02:09:06 -05:00
Matthew D. Scholefield d3920f36dd Add threshold parameters and precise-calc-threshold script
This is used to produce a more linear output
2019-04-08 15:08:16 -05:00
Matthew D. Scholefield 18ab3d1e1d Refine graph visualization on data file 2019-04-03 05:48:18 -05:00
Matthew D. Scholefield b3f2ff8a2d Add option to print stats to file 2019-04-03 05:14:57 -05:00
Matthew D. Scholefield b4c28e1771 Drastically improve precise-graph speed
It now uses numpy arrays instead of Python loops
2019-04-03 04:42:42 -05:00
Matthew D. Scholefield baf08cd7ee Add pyache data loading
This enables loading the cache as a block without risking filling up the harddrive
2019-03-29 06:40:14 -05:00
Matthew D. Scholefield 66eed19660 Move model creation before data loading
This allows it to error if the model isn't correct before loading data which is less annoying
2019-03-29 06:00:55 -05:00
Matthew D. Scholefield 608c9b43f7 Add threshold to precise-train-incremental 2019-03-29 02:58:00 -05:00
Matthew D. Scholefield 61d52929e5 Make precise-eval use new stats object
Fixes import error
2019-03-21 17:45:09 -05:00
Matthew D. Scholefield 00ca1fc683 Add threshold command line option to scripts
Also makes the term threshold consistent in code
2019-03-20 23:36:08 -05:00
Matthew D. Scholefield 9453f8a2d1 Add more options to graph script 2019-03-20 23:12:10 -05:00
Matthew D. Scholefield 63e5553129 Use new Stats class in precise-test 2019-03-20 22:33:59 -05:00
Matthew D. Scholefield 4cd1927efe Update copyright header to 2019 2019-03-20 10:53:24 -05:00
Matthew D. Scholefield a8a7cea1c6 Add missing method docstring 2019-03-20 10:52:25 -05:00
Matthew D. Scholefield e89677a84f Add precise-train-generated script 2019-03-20 10:45:39 -05:00
Matthew D. Scholefield 02da99e21d Add precise-graph script to show ROC curves 2019-03-20 00:05:59 -05:00
Matthew Scholefield 692df01e01 Make shuffling configurable (Fixes #28)
This fixes filenames in precise-test being incorrect
2018-10-15 14:12:40 -05:00
Matthew Scholefield da286a2dd7 Make noise ratio configurable via command line 2018-10-09 19:07:48 -05:00
Matthew Scholefield 78603bd3c2 Add precise-add-noise script
This is used to generate noise into a dataset
2018-09-05 05:02:52 -05:00
Matthew Scholefield 90d8671cf7 Fix delay samples in train-incremental
Also fixes bug with model parameters
2018-09-05 01:53:07 -05:00
Matthew Scholefield b3e6efaf53 Fix failing to load params
Fixes #26
2018-08-11 10:12:34 -05:00
Matthew Scholefield 80b13db2e7 Improve formatting line break 2018-08-10 00:03:16 -05:00
Matthew Scholefield 02fa053653 Fix loss bias in trainer.py 2018-08-10 00:02:39 -05:00
Matthew Scholefield 63b4592675 Fix activations_per_day in precise-simulate 2018-08-10 00:01:16 -05:00
Matthew Scholefield e43498d2ea Explicitly delete large vectors
This reduces potential memory overlap
2018-08-10 00:00:30 -05:00
Matthew Scholefield d71ea3fee0 Add visual element to precise-listen
The previous default `precise-listen` is not `precise-listen -l`
2018-08-09 11:36:10 -05:00
Matthew D. Scholefield 8cfbd41d8c
Fix Python 3.4 compatibility in train-incremental 2018-08-07 16:27:56 -05:00
Matthew D. Scholefield fd2b71b069
Replace Python 3.5+ syntax
Otherwise it errors on Python 3.4
2018-08-06 16:54:26 -05:00
Matthew Scholefield 7b802be7b8 Move Trainer into precise.scripts.train
Not having it there was inconsistent because the other trainer classes are in the scripts package within the respective scripts
2018-07-26 13:19:10 -05:00
Matthew Scholefield 9642fcc07f Inject params in precise-simulate 2018-07-25 10:06:14 -05:00
Mikhail Dmitrienko 81a8b18986 Removed redundant code (#20)
Removed a redundant line of code. print("False positive: ", false_positives * 100, "%") is already printed so print(false_positives) isn't needed.
2018-07-16 15:22:00 -05:00
Mikhail Dmitrienko 75e0769026 Changed the maximum possible amount of units (#19)
Changed the maximum possible amount of units for the optimization to return to 70 units.
2018-07-16 11:57:43 -05:00
Matthew Scholefield d6db6c8ec2 Make train_optimize inherit from Trainer 2018-07-12 21:22:08 -05:00
Matthew Scholefield 7f915f939d Remove unused variables 2018-07-12 17:21:54 -05:00
Matthew Scholefield 3549765a84 Move module level code into main function 2018-07-12 17:21:54 -05:00
Matthew Scholefield 4d1f212c2b Remove environment specific definition 2018-07-12 17:21:54 -05:00
Matthew Scholefield c5dd7c891d Autoformat and remove unused imports 2018-07-12 17:21:54 -05:00
Matthew Scholefield 5818a101da Add license header 2018-07-12 17:21:54 -05:00
Matthew Scholefield 4f5df1b997 Make imports absolute 2018-07-12 17:21:54 -05:00
Matthew Scholefield ac43e4b6bb Add .py extension to train_optimize
Also rename to train_optimize to be consistent with verbiage
2018-07-12 17:21:54 -05:00
mikhaildmitrienko 01dc86896d Created train_optimizer.py 2018-07-12 17:21:54 -05:00
Matthew Scholefield 7d97cd2331 Add simulate script 2018-07-12 16:57:02 -05:00
Matthew Scholefield d8dd0f3240 Shuffle training and testing data before training
This fixes issues with small batch sizes and metrics
2018-07-11 19:32:39 -05:00
Matthew Scholefield 06d9669e79 Add sampled training support 2018-07-11 12:45:41 -05:00