Commit Graph

172 Commits (7b256df1e963d47e90a815c43f33e9de1cb17158)

Author SHA1 Message Date
Przemek Wirkus a8506caa1d Refactored few more tests to support autodetection: basic, call_before_main, dev_null, rtc, stdio 2015-01-27 12:51:53 +00:00
Przemek Wirkus 6903b54b9e Refactored generic tests with timer host test supervision
Reactored RTOS tests
2015-01-27 12:10:16 +00:00
Przemek Wirkus 2ab22b1dbe Host test plugins: removed shutil.copy() dependency and added re module import - note this plugin is still unstable so change is just cosmetic 2014-11-17 16:07:18 +00:00
Przemek Wirkus 7e11ffd173 Fixed traceback from host_test_plugin - formating issue with integer 2014-11-17 15:45:10 +00:00
Przemek Wirkus 54c06c8b84 Host test plugins: Ethernet tests (NET_*) refactored to new host test copy paradigm 2014-10-30 15:22:02 +00:00
Przemek Wirkus 7646c51d7e Host test plugins: minor updates 2014-10-30 14:26:52 +00:00
Przemek Wirkus 7cc6a2bf1c Host test plugins: Modified WAIT_US_AUTO host test to take under consideration 10 consecutive timer ticks within deviation 2014-10-29 17:45:08 +00:00
Przemek Wirkus 93a87748a3 Host test plugins: bug-fix: serial_timeout was used as function name and class member. Caused runtime script problem
Host test plugins: Increased test suite timeout on each test execution twice - for now, so tests do not timeout. TODO: exclude coopy and reset procedures from testcase timeout measurement
2014-10-29 17:21:55 +00:00
Przemek Wirkus 3d4e03d0da Host test plugins: added custom serial port configuration, baudrate and timeout. This can now be done before host test will call run() function 2014-10-29 17:00:10 +00:00
Przemek Wirkus 5ef767a880 Host test plugins: Added prints to serial_init() function 2014-10-29 14:34:20 +00:00
Przemek Wirkus c4397b75b7 Host test plugins: moved program cycle sleep time to host_test - this delay is used to give time device to flash copied file 2014-10-29 14:28:02 +00:00
Przemek Wirkus e984b51e49 Host test plugins: removed usused extra_baud parameter from serial port initialization 2014-10-29 14:02:16 +00:00
Przemek Wirkus 7d5d0d116c Host test plugins: Bug-fix: Wrong variable was checked against None while readling line from serial port 2014-10-29 10:55:02 +00:00
Przemek Wirkus b3b6d848b5 Host test plugins: refactored UDP LINK LAYER testcase to use test() method instead of run() 2014-10-28 14:50:47 +00:00
Przemek Wirkus b404b21098 Host test plugins: refactored TCP ECHO SERVER testcase to use test() method instead of run() 2014-10-28 14:44:26 +00:00
Przemek Wirkus 52f0b33e7a Host test plugins: refactored UDP ECHO SERVER testcase to use test() method instead of run() 2014-10-28 14:38:15 +00:00
Przemek Wirkus c0895fdbfc Host test plugins: removed unused self.mbed.reset() call in test constructor. No need for two resets because reset is performed in run() function 2014-10-28 14:01:05 +00:00
Przemek Wirkus 00904b5f24 Host test plugins: refactored TestResults class to HostTestResults name 2014-10-28 11:44:45 +00:00
Przemek Wirkus c0134d66fb Host test plugins: run() function will just print result from test() function directly, not check boolean state from test 2014-10-28 11:40:41 +00:00
Przemek Wirkus b9cee9709e Host test plugins: Default host test aligned and refactored so it can be invoked via run() function 2014-10-28 11:36:46 +00:00
Przemek Wirkus 4f76a567f6 Host test plugins: Added extra line for error printing in mbed copy plugin. For readability reasons 2014-10-28 11:29:56 +00:00
Przemek Wirkus 4d8dfed27f Host test copy functionality migration: copy functionality partially moved to host_test (tested with basic set of tests, not with e.g. NET tests.
Host test copy functionality: TODO: modify rest of host tests to use self.mbed.reset() and self.mbed.copy_image() according to curent test scipt API
2014-10-27 16:38:19 +00:00
Przemek Wirkus a25f5ceaaa Host test copy functionality migration: removed all extra port and disk functionality. It will be added when it is really needed 2014-10-27 15:50:33 +00:00
Przemek Wirkus ae4be96c86 Host test copy functionality migration: added required parameters for host_test.py command line: path to image, copy method 2014-10-27 15:46:15 +00:00
Przemek Wirkus 97c220d56e Host test plugins: rearranged singletest.py script parameters list so now for option -c and -r (copy method and reset method respectively) we will see plugin related options also - changed dynamicaly with plugin loads 2014-10-27 12:42:48 +00:00
Przemek Wirkus 48490022ed Host test plugins: Removed unused / not stable plugins static registration 2014-10-27 11:53:28 +00:00
Przemek Wirkus 9700aff0a6 Host test plugins: Bug-fix, notification about already loaded plugin was printed always in plugin registration 2014-10-27 11:48:30 +00:00
0xc0170 7abbd9c5a8 Merge branch 'host-test-plugin-improvements' of github.com:PrzemekWirkus/mbed into PrzemekWirkus-host-test-plugin-improvements
Conflicts:
	workspace_tools/host_tests/host_test.py
2014-10-27 08:08:52 +00:00
Przemek Wirkus 69cc2fb86a Host test plugins: removed unused pass statement 2014-10-23 17:24:51 +01:00
Przemek Wirkus 2f03b85bfc Host test plugins: Added generic error printing to host test plugin base class 2014-10-23 17:14:18 +01:00
Przemek Wirkus 17f42519f0 Host test plugins: Added MPS2 and Firfox copy methods (both not stable and require further development)
Host test plugins: Added 'stable' attribute to each plugin, by default all plugins are not stable

Moved all MPS2 related functions to MPS2 plugins in host test directory
2014-10-23 16:56:05 +01:00
Przemek Wirkus 6a1bdb588e Host test plugins: added copy pligins, and removed Selenium and eACommander dependency from Test API 2014-10-23 16:30:17 +01:00
Przemek Wirkus efb46ca7de Host test plugins: moved serial port flashing just before plugin reset call 2014-10-22 17:49:54 +01:00
Przemek Wirkus 7591cf5caf Host test plugins: added return values to setup() and execute() interface methods 2014-10-22 16:59:07 +01:00
Przemek Wirkus 3f00c59030 Host test plugins: Added license and fxed one parsing issue 2014-10-22 15:35:36 +01:00
Przemek Wirkus 8af8250b48 Host test plugins: Cleaned preliminary code before next round of refactoring and improvements 2014-10-22 15:30:45 +01:00
Przemek Wirkus fd2142f3bf Host test plugins: First draft with working pluging for mbed (serial sendBreak command for reset) 2014-10-22 15:12:24 +01:00
Przemek Wirkus b786c4c0f6 Minor style improvement 2014-10-21 13:53:19 +01:00
Przemek Wirkus 5bca0ab3d1 Cleaned pyFlakes issues with unused imports 2014-10-21 13:18:22 +01:00
Przemek Wirkus 3850ddc8c1 Host test refactoring: cleaned a bit functionality of host tests. Forced test() function in DefaultTest to be method returning test result 2014-10-21 13:12:32 +01:00
Przemek Wirkus 755565d854 Host test refactoring
Host test refactoring: replaced magic values of test results returned by host test

Prints with stdout.flush() replaced with notify function

Host test refactoring: created separate enum like class for test result strings
2014-10-17 15:14:53 +01:00
Przemek Wirkus 945604e16e RTC test readline timeout increased to 10 seconds. Reason: RTC test is fail on Nucleo boards which don’t have the LSE xtal. This is because there is a timeout in the code of several seconds to wait until the LSE clock has startup. 2014-10-15 17:19:36 +01:00
Przemek Wirkus 567f4a170f Refactoring of report exporter to support HTML and JUNIT. Modified host tests to support serial and copy issues in more generic way. Copy in test suite and serial in host_test control flow. 2014-10-15 11:33:37 +01:00
Przemek Wirkus 2ab8ad9b47 Feature: Device detection via serial - part 4
Interrupt In test pinology for NUCLEO changed
2014-09-24 14:58:14 +01:00
Przemek Wirkus da412da174 Feature: Device detection via serial - part 3 2014-09-24 14:58:10 +01:00
Przemek Wirkus 6690db1444 Feature: Device detection via serial - part 2 2014-09-24 14:58:07 +01:00
Przemek Wirkus e3e49cb67d Small improvements to ETH test cases - handle not open socket on host test side 2014-09-24 14:57:52 +01:00
Przemek Wirkus 466c3b4d75 Added stdio receive time in host test prints 2014-09-22 10:43:21 +01:00
Przemek Wirkus ea59d77d85 Small improvements to RTC test to check time elapsed and if timestamp is not zero 2014-09-22 10:06:39 +01:00
Przemek Wirkus f92bd88f98 Removed small typo from host test 2014-09-16 14:40:25 +01:00
Przemek Wirkus 9fb3c45f64 Small change in repamble readline comparision function 2014-09-16 10:53:24 +01:00
Przemek Wirkus 63ee01bdd9 Modified host tests to use serial.realine() function to avoid extra timeouts during tests (test will work faster and will be more reliable) 2014-09-15 17:44:30 +01:00
Przemek Wirkus 0748ef4a2a Modified host tests to use serial.realine() function to avoid extra timeouts during tests (test will work faster and will be more reliable) 2014-09-15 17:44:26 +01:00
Przemek Wirkus 8c77115d55 Modified host tests to use serial.realine() function to avoid extra timeouts during tests (test will work faster and will be more reliable) 2014-09-15 17:44:22 +01:00
Przemek Wirkus 97f526cc8c Modified DEV_NULL host test to take under consideration blocking serial port API 2014-09-11 13:38:58 +01:00
Przemek Wirkus 2efe99a100 Global serial read changed to 1 second 2014-09-11 13:28:10 +01:00
Przemek Wirkus 29dbc34202 Changed default serial timeout for host test 2014-09-11 13:28:06 +01:00
Przemek Wirkus e066b84f1c For timer / timeout related tests deviation changed to +/- 10% - some boards can run on not precise quartz / RC oscilators 2014-09-10 12:44:27 +01:00
Przemek Wirkus eec7671fa0 For timer / timeout related tests deviation changed to +/- 10% - some boards can run on not precise quartz / RC oscilators 2014-09-08 11:49:04 +01:00
Przemek Wirkus 41c7771268 Fixed small typu and added print to RTC host test 2014-09-05 11:51:21 +01:00
Przemek Wirkus beed8358f9 Improvements to RTC's host_test test case 2014-09-04 15:30:08 +01:00
Przemek Wirkus c12b5de37b Fixed NET_(4,6,13) client tests so after reset we wait for device to send print it's ready
Fixed small print issue with -V option
2014-09-04 10:10:55 +01:00
Przemek Wirkus 2df3125ca4 Fixed missing STDOUT in Echo test
Fixed missing opening and closing brackets in {{start}}
2014-09-03 15:01:19 +01:00
Przemek Wirkus 61b1d75032 Added dynamic test printing 2014-09-03 14:27:53 +01:00
Przemek Wirkus 4e3b149f79 Modified STDIO and ECHO so they use rpeamble to initialize communication 2014-09-03 13:33:54 +01:00
Przemek Wirkus 828ba90dcd Added 'real-time' test result printing when tests are executed (view test execution progress using option -V) 2014-09-03 13:33:50 +01:00
Przemek Wirkus d71a7579b4 Removed from Hello World target test success notification 2014-09-02 15:50:24 +01:00
Przemek Wirkus 1bdc4b8046 Simplified HelloWorld test to detect different types of ragteId (they can have different length) 2014-09-02 15:24:51 +01:00
Przemek Wirkus b481bc4319 Modified test EXAMPLE_1 to fail if can't receive proper print from Mbed 2014-09-02 14:52:24 +01:00
Przemek Wirkus b45361a4d4 Flush separated for different methods 2014-09-01 17:05:00 +01:00
Przemek Wirkus 9cf976e827 Flushing serials after reset added as test stability improvement 2014-09-01 16:27:54 +01:00
Przemek Wirkus 6a9e726ccd Flushing serials after reset added as test stability improvement 2014-09-01 16:25:00 +01:00
Przemek Wirkus 2c166222b6 Added parent directory to import path to host test script so we can now impoer workspace_tools.* as we do in other scripts - problem was host_test.py and other tests run with custom CWD and imports are not easy to maintain 2014-09-01 16:10:24 +01:00
Przemek Wirkus e25ffc7856 Added to switch -c option 'eACommander' and 'eACommander-usb'
Added to switch --reset-type option 'eACommander' and 'eACommander-usb'
2014-09-01 15:13:42 +01:00
Przemek Wirkus ab2433cac2 Test bugfix: bugfixed RTOS (mutex, semaphore) - not thread safe stdio causes test result prints to be interrupted by threads' printing
test bugfix: added support for targetID print from device for 'hello world' and 'stdio' testcases
2014-08-15 11:17:52 +01:00
Przemek Wirkus 278acbec5d Host test: wrapped mbed.serial.timeout into separate function to avoid traceback and send proper IO_SERIAL error from host test(s) 2014-08-14 11:29:56 +01:00
Przemek Wirkus a5bdd4a8bb More comments added to methods in host_test.py 2014-08-13 11:29:06 +01:00
Przemek Wirkus 005c3a7b87 Host test: wrapped timeout for MUTs serial port access to handle IO_SERIAL error while accessing serial port 2014-08-13 11:11:51 +01:00
Przemek Wirkus 17c0132d56 Added parts of functionality related to extra reset types, global timeout increments and image configuration file modifications 2014-08-13 10:26:50 +01:00
Przemek Wirkus 64640c8880 Feature: MPS2 reset functionality implementation (not finished and will not break current implementation) 2014-08-13 10:26:43 +01:00
Przemek Wirkus 13c6c4f13e Refactoring: created test_api.py and moved test code and classes to separate test api file. Prepareing to add MPS2 reset functionality 2014-08-04 14:29:46 +01:00
Przemek Wirkus d5b7006223 Added reset option to host_test so in the future we can use different reset type, e.g. touch reset.txt on systems like MPS2 boards 2014-07-30 17:53:03 +01:00
Przemek Wirkus 0725b33375 Added exception handling for prettytable and serial modules - gracefuly handle missing imports. 2014-07-11 11:24:03 +01:00
Przemek Wirkus 41a7dada69 Removed TODO section in comments - all TODOs are fixed and implemented now. 2014-07-11 10:34:52 +01:00
Przemek Wirkus a1c9c941b5 Added serial port wrappers for read/write instead of raw serial port access to access MUT serial port. This will allow to catch more issues with communication with MUT during tests. This will also 'hide' tracebacks from test suite execution. 2014-07-10 14:54:05 +01:00
Przemek Wirkus 82e4a672ca Added seral port read/write wrappers to handle serial port communication issues. Added IOERR_SERIAL handler for basic test. Other tests will be refactored in separate commits. 2014-07-10 14:51:56 +01:00
Przemek Wirkus 10974f29f3 Removed unused 'pass' statement 2014-07-10 10:58:09 +01:00
Przemek Wirkus f3567d4f1a pyFlakes issues fixed. Simple refactoring 2014-07-10 10:58:07 +01:00
Przemek Wirkus 7c6ece5764 pyFlakes issues fixed. Simple refactoring 2014-07-10 10:58:05 +01:00
Przemek Wirkus e7c8010fe5 pyFlakes issues fixed. Simple refactoring 2014-07-10 10:58:02 +01:00
Przemek Wirkus f55c0aca43 pyFlakes issues fixed. Simple refactoring 2014-07-10 10:58:00 +01:00
Przemek Wirkus 7a5d00bd65 pyFlakes issues fixed. Simple refactoring 2014-07-10 10:57:58 +01:00
Przemek Wirkus 3ce8116fb2 pyFlakes issues fixed. Simple refactoring 2014-07-10 10:57:56 +01:00
Przemek Wirkus 803c92438d pyFlakes issues fixed. Simple refactoring 2014-07-10 10:57:53 +01:00
Przemek Wirkus 0fef3ba498 pyFlakes issues fixed. Simple refactoring 2014-07-10 10:57:51 +01:00
Przemek Wirkus 89ef186680 pyFlakes issues fixed. Simple refactoring 2014-07-10 10:57:49 +01:00
Przemek Wirkus 005ed7ec4a pyFlakes issues fixed. Simple refactoring 2014-07-10 10:57:47 +01:00
Przemek Wirkus 362d6c83ff Added TODO for test suite improvements. 2014-07-04 14:52:09 +01:00
Przemek Wirkus 0c937bb333 Added more todo to host test file 2014-06-26 17:44:11 +01:00
Przemek Wirkus 9b1c07195e Added TODO to fix issues with serial detection 2014-06-26 11:11:57 +01:00