Matthew D. Scholefield
cc84253cda
Remove optimizer dependencies
...
They aren't even used for most scripts and cause lots of problems
2020-01-30 16:29:11 -06:00
Matthew D. Scholefield
a37958f3f2
Add fixes identified by test cases
2019-11-01 01:16:21 -05:00
Matthew D. Scholefield
4cec9b0767
Overhaul of how scripts are written to allow programmatic access
...
This introduces a way for scripts to be easily called from within Python with command line arguments as function parameters
To support this, prettyparse has been upgraded to the latest version
2019-11-01 00:03:44 -05:00
Matthew D. Scholefield
e1211d0af0
Fix Python 3.4 compatibility with precise-train-sampled
2019-04-15 16:21:58 +00:00
Matthew D. Scholefield
302ae48d60
Fix precise-train-optimize on Python 3.4
2019-04-15 15:50:21 +00:00
Matthew D. Scholefield
116f596292
Remove variable tagger
...
Not useful. Was only created as an experiment and included accidentally
2019-04-10 05:11:35 -05:00
Matthew D. Scholefield
06430cd24d
Add --freeze-till training parameter for transfer learning
...
For example, --freeze-till -2 will freeze layers[0:-2]
2019-04-09 02:09:06 -05:00
Matthew D. Scholefield
d3920f36dd
Add threshold parameters and precise-calc-threshold script
...
This is used to produce a more linear output
2019-04-08 15:08:16 -05:00
Matthew D. Scholefield
18ab3d1e1d
Refine graph visualization on data file
2019-04-03 05:48:18 -05:00
Matthew D. Scholefield
b3f2ff8a2d
Add option to print stats to file
2019-04-03 05:14:57 -05:00
Matthew D. Scholefield
b4c28e1771
Drastically improve precise-graph speed
...
It now uses numpy arrays instead of Python loops
2019-04-03 04:42:42 -05:00
Matthew D. Scholefield
baf08cd7ee
Add pyache data loading
...
This enables loading the cache as a block without risking filling up the harddrive
2019-03-29 06:40:14 -05:00
Matthew D. Scholefield
66eed19660
Move model creation before data loading
...
This allows it to error if the model isn't correct before loading data which is less annoying
2019-03-29 06:00:55 -05:00
Matthew D. Scholefield
608c9b43f7
Add threshold to precise-train-incremental
2019-03-29 02:58:00 -05:00
Matthew D. Scholefield
61d52929e5
Make precise-eval use new stats object
...
Fixes import error
2019-03-21 17:45:09 -05:00
Matthew D. Scholefield
00ca1fc683
Add threshold command line option to scripts
...
Also makes the term threshold consistent in code
2019-03-20 23:36:08 -05:00
Matthew D. Scholefield
9453f8a2d1
Add more options to graph script
2019-03-20 23:12:10 -05:00
Matthew D. Scholefield
63e5553129
Use new Stats class in precise-test
2019-03-20 22:33:59 -05:00
Matthew D. Scholefield
4cd1927efe
Update copyright header to 2019
2019-03-20 10:53:24 -05:00
Matthew D. Scholefield
a8a7cea1c6
Add missing method docstring
2019-03-20 10:52:25 -05:00
Matthew D. Scholefield
e89677a84f
Add precise-train-generated script
2019-03-20 10:45:39 -05:00
Matthew D. Scholefield
02da99e21d
Add precise-graph script to show ROC curves
2019-03-20 00:05:59 -05:00
Matthew Scholefield
692df01e01
Make shuffling configurable ( Fixes #28 )
...
This fixes filenames in precise-test being incorrect
2018-10-15 14:12:40 -05:00
Matthew Scholefield
da286a2dd7
Make noise ratio configurable via command line
2018-10-09 19:07:48 -05:00
Matthew Scholefield
78603bd3c2
Add precise-add-noise script
...
This is used to generate noise into a dataset
2018-09-05 05:02:52 -05:00
Matthew Scholefield
90d8671cf7
Fix delay samples in train-incremental
...
Also fixes bug with model parameters
2018-09-05 01:53:07 -05:00
Matthew Scholefield
b3e6efaf53
Fix failing to load params
...
Fixes #26
2018-08-11 10:12:34 -05:00
Matthew Scholefield
80b13db2e7
Improve formatting line break
2018-08-10 00:03:16 -05:00
Matthew Scholefield
02fa053653
Fix loss bias in trainer.py
2018-08-10 00:02:39 -05:00
Matthew Scholefield
63b4592675
Fix activations_per_day in precise-simulate
2018-08-10 00:01:16 -05:00
Matthew Scholefield
e43498d2ea
Explicitly delete large vectors
...
This reduces potential memory overlap
2018-08-10 00:00:30 -05:00
Matthew Scholefield
d71ea3fee0
Add visual element to precise-listen
...
The previous default `precise-listen` is not `precise-listen -l`
2018-08-09 11:36:10 -05:00
Matthew D. Scholefield
8cfbd41d8c
Fix Python 3.4 compatibility in train-incremental
2018-08-07 16:27:56 -05:00
Matthew D. Scholefield
fd2b71b069
Replace Python 3.5+ syntax
...
Otherwise it errors on Python 3.4
2018-08-06 16:54:26 -05:00
Matthew Scholefield
7b802be7b8
Move Trainer into precise.scripts.train
...
Not having it there was inconsistent because the other trainer classes are in the scripts package within the respective scripts
2018-07-26 13:19:10 -05:00
Matthew Scholefield
9642fcc07f
Inject params in precise-simulate
2018-07-25 10:06:14 -05:00
Mikhail Dmitrienko
81a8b18986
Removed redundant code ( #20 )
...
Removed a redundant line of code. print("False positive: ", false_positives * 100, "%") is already printed so print(false_positives) isn't needed.
2018-07-16 15:22:00 -05:00
Mikhail Dmitrienko
75e0769026
Changed the maximum possible amount of units ( #19 )
...
Changed the maximum possible amount of units for the optimization to return to 70 units.
2018-07-16 11:57:43 -05:00
Matthew Scholefield
d6db6c8ec2
Make train_optimize inherit from Trainer
2018-07-12 21:22:08 -05:00
Matthew Scholefield
7f915f939d
Remove unused variables
2018-07-12 17:21:54 -05:00
Matthew Scholefield
3549765a84
Move module level code into main function
2018-07-12 17:21:54 -05:00
Matthew Scholefield
4d1f212c2b
Remove environment specific definition
2018-07-12 17:21:54 -05:00
Matthew Scholefield
c5dd7c891d
Autoformat and remove unused imports
2018-07-12 17:21:54 -05:00
Matthew Scholefield
5818a101da
Add license header
2018-07-12 17:21:54 -05:00
Matthew Scholefield
4f5df1b997
Make imports absolute
2018-07-12 17:21:54 -05:00
Matthew Scholefield
ac43e4b6bb
Add .py extension to train_optimize
...
Also rename to train_optimize to be consistent with verbiage
2018-07-12 17:21:54 -05:00
mikhaildmitrienko
01dc86896d
Created train_optimizer.py
2018-07-12 17:21:54 -05:00
Matthew Scholefield
7d97cd2331
Add simulate script
2018-07-12 16:57:02 -05:00
Matthew Scholefield
d8dd0f3240
Shuffle training and testing data before training
...
This fixes issues with small batch sizes and metrics
2018-07-11 19:32:39 -05:00
Matthew Scholefield
06d9669e79
Add sampled training support
2018-07-11 12:45:41 -05:00