Commit Graph

344 Commits (0e86fa25292955744fdeca8cbe3556344b360fcd)

Author SHA1 Message Date
Marcus Chang d60bed2da9 Increase clock tolerance in Flash HAL test
The current 0.1% clock tolerance is too small for certain platforms
which natural variance is larger than this. This commit increases the
tolerance to 0.5% instead.

Sample output from time_cpu_cycles called repeatedly in init,
before running any flash tests:

[1515706585.63][CONN][RXD] diff: 49316
[1515706585.69][CONN][RXD] diff: 49256
[1515706585.75][CONN][RXD] diff: 49286
[1515706585.81][CONN][RXD] diff: 49256
[1515706585.87][CONN][RXD] diff: 49225
[1515706585.94][CONN][RXD] diff: 49286
[1515706585.99][CONN][RXD] diff: 49317
[1515706586.06][CONN][RXD] diff: 49255
[1515706586.12][CONN][RXD] diff: 49286
[1515706586.18][CONN][RXD] diff: 49285
[1515706586.24][CONN][RXD] diff: 49286
[1515706586.31][CONN][RXD] diff: 49347
[1515706586.36][CONN][RXD] diff: 49347
[1515706586.43][CONN][RXD] diff: 49286
[1515706586.49][CONN][RXD] diff: 49286
[1515706586.55][CONN][RXD] diff: 49256
[1515706586.61][CONN][RXD] diff: 49286
[1515706586.68][CONN][RXD] diff: 49346
[1515706586.74][CONN][RXD] diff: 49347
[1515706586.80][CONN][RXD] diff: 49256

Notice the outliers will cause intermittent CI failures.
2018-01-11 13:44:51 -08:00
Senthil Ramakrishnan d82566cc6b Fix tcp_hello_world test to receive all the data from http response 2018-01-08 14:18:06 -06:00
Senthil Ramakrishnan 47390e62d6 ESP8266 test config and tcp_echo test fix for ESP8266 2018-01-08 14:18:06 -06:00
Jimmy Brisson 954960c2a1
Merge pull request #5784 from 0xc0170/fix_rtc_result
RTC test: fix __result variable
2018-01-08 10:38:26 -06:00
Przemyslaw Stekiel e725b4c2c5 RTC time conversion test - reduce number of tested years in order to reduce test execution time.
For each of the following years test example time of the first and last day of each month:
- first - 1970
- example not leap year (not divisible by 4)
- example leap year (divisible by 4 and by 100 and by 400)
- example leap year (divisible by 4 and not by 100)
- example not leap year (divisible by 4 and by 100)
- last fully supported  - 2105

Test execution time on K64F is now ~39 sec.
2018-01-08 10:14:54 +01:00
Jimmy Brisson c00efaec44
Merge pull request #5737 from jeromecoutant/PR_LP_TIMER_TEST
lp_timer test : add a minimum delta value
2018-01-04 10:03:53 -06:00
Jimmy Brisson b12d0fb56b
Merge pull request #5673 from maciejbocianski/mem_trace_tests
mem_trace tests refactoring
2018-01-04 09:54:40 -06:00
Jimmy Brisson 18e727623d
Merge pull request #5435 from mikaleppanen/emac_tests
Tests for wifi emac interface
2018-01-04 09:48:45 -06:00
Martin Kojtal 77cc7c7c8f RTC test: fix __result variable
Not needed, neither used anywhere. Teardown also can
be removed
2018-01-04 13:19:13 +00:00
jeromecoutant 9a43912177 lp_timer test : add a minimum delta value 2018-01-03 15:37:19 +01:00
Anna Bridge 2f4f82ec74
Merge pull request #5723 from SeppoTakalo/wifi-construtor-fix
Remove destruction of WiFi interface in test runs
2017-12-29 14:29:38 +00:00
Cruz Monrreal II 43af0d7395
Merge pull request #5743 from VeijoPesonen/greentea-wifi-fixes-disconnect
Greentea wifi test cases - disconnect done as teardown after each connect
2017-12-28 21:02:42 +00:00
Veijo Pesonen 5585ba60a5 Greentea test case WIFI-CONNECT-NOCREDENTIALS- accept also parameter error if AP is not found 2017-12-22 13:02:06 +02:00
Veijo Pesonen c993057537 Security protocol made configurable via json 2017-12-22 12:54:22 +02:00
Veijo Pesonen 402ab81730 remove disconnect from test cases as it's going to be called implicitly from get_interface-function 2017-12-22 10:18:28 +02:00
Maciej Bocianski cc580d7532 mem_trace tests refactoring 2017-12-22 07:56:56 +01:00
Veijo Pesonen ca95e3f88b Greentea WIFI-CONNECT-SECURE must use NSAPI_SECURITY_WPA_WPA2 2017-12-21 08:29:09 +02:00
Veijo Pesonen f71756cf98 Greentea WIFI-SCAN - make possible to disable check against assumed channel
It's possible that a device does not support setting the channel to be used.
In case channel is not set by the device lets disable the check.
2017-12-21 08:29:09 +02:00
Veijo Pesonen 8c421e20d6 Greentea Wifi testcase fixes
Call disconnect when connect has been tested. Also instead of waiting
for parameter error in case of missing SSID give missing SSID error
code.
2017-12-21 08:29:09 +02:00
TomoYamanaka 4f4b4ddf36 Change the "thread" test main for Cortex-A
In pararell threads of "thread" test is a simple thread, but it seems that there is a difference in the stack used between Cortex-A and Cortex-M.
As a result of check, in Cortex-A, program aborts because of the lack of stack when PARALLEL_THREAD_STACK_SIZE is 384, workes properly when PARALLEL_THREAD_STACK_SIZE is 512 at least.
2017-12-21 14:09:24 +09:00
TomoYamanaka a105f6f356 Change the "malloc" test main for Cortex-A
"malloc" test is used a simple thread that executes only malloc and free, but it seems that there is a difference in the stack used between Cortex-A and Cortex-M.
As a result of check, in Cortex-A, program aborts because of the lack of stack  when THREAD_STACK_SIZE is 256, workes properly when THREAD_STACK_SIZE is 512 at least. Since it seems that the definition processing of "DEFAULT_STACK_SIZE" was gone from Mbed OS by updating CMSIS5/RTX5, I setted 512 directly for Cortex-A.
2017-12-21 14:09:24 +09:00
TomoYamanaka 698de3b5ff Modify 2-byte code of "heap and stack" test main for Cortex-A
I modified "space" character from 2-byte code to 1-byte code in "heap and stack" test main.
2017-12-21 14:09:24 +09:00
Seppo Takalo 8bfe5779b3 Remove destruction of WiFi interface in test runs
Most of our IP stacks don't allow removal of interfaces so
interface destructor can not reliably clean up. Therefore we
cannot rely its behaviours in test case.

Instead run interface->disconnect() in case interface was already
created.
2017-12-20 16:58:11 +02:00
Martin Kojtal 63a923752b
Merge pull request #5568 from VeijoPesonen/greentea-wifi-fixes
Greentea Wifi testcase fixes
2017-12-20 14:52:44 +00:00
Martin Kojtal b89cf3ff75
Merge pull request #5578 from mprse/CircularBuffer_tests
CircularBuffer class modification and test
2017-12-20 14:51:44 +00:00
Martin Kojtal bea41d1ebb
Merge pull request #5635 from c1728p9/fix_lazy_init
Protect local static object construction in ARMCC
2017-12-12 17:41:21 +00:00
Martin Kojtal 5c98ca56fc
Merge pull request #5648 from maciejbocianski/singletonPtr_tests
Add SingletonPtr test
2017-12-12 17:40:36 +00:00
Martin Kojtal be52ba2156
Merge pull request #5363 from mprse/extended_rtc
Add support and tests for extended RTC
2017-12-12 17:36:44 +00:00
Martin Kojtal 57a5735387
Merge pull request #5576 from jeromecoutant/PR_IP
Ethernet tests update
2017-12-12 17:31:23 +00:00
Przemyslaw Stekiel fcdaeccea1 Add tests for extended RTC. 2017-12-05 07:53:41 +01:00
jeromecoutant d8cc5a3850 tests-netsocket-socket_sigio
HTTP_SERVER_NAME and HTTP_SERVER_FILE_PATH are replaced by
  MBED_CONF_APP_HTTP_SERVER_NAME and MBED_CONF_APP_HTTP_SERVER_FILE_PATH
  to allow user to make local tests

Test on HTTP connect added as test was always OK even with no connection...
2017-12-04 17:55:11 +01:00
jeromecoutant bff8fc1534 tests-netsocket-tcp_hello_world
HTTP_SERVER_NAME and HTTP_SERVER_FILE_PATH are replaced by
  MBED_CONF_APP_HTTP_SERVER_NAME and MBED_CONF_APP_HTTP_SERVER_FILE_PATH
  to allow user to make local tests
2017-12-04 17:55:10 +01:00
jeromecoutant df27bca67d tests-netsocket-tcp_echo
UUID lines are removed as they were not used

default case:
If MBED_CONF_APP_ECHO_SERVER_ADDR and MBED_CONF_APP_ECHO_SERVER_PORT are not defined
test is using Greentea to get server information (code before OS 5.6.1 version)

TCP_ECHO_PREFIX is no more a mandatory step
2017-12-04 17:55:09 +01:00
jeromecoutant 3cb8316993 tests-netsocket-udp_echo
UUID lines are removed as they were not used

default case:
If MBED_CONF_APP_ECHO_SERVER_ADDR and MBED_CONF_APP_ECHO_SERVER_PORT are not defined
test is using Greentea to get server information (code before OS 5.6.1 version)
2017-12-04 17:55:08 +01:00
jeromecoutant 61b8468db9 tests-netsocket-gethostbyname
MBED_DNS_TEST_HOST define is replaced by MBED_CONF_APP_DNS_TEST_HOST to allow user to change host name for local tests
2017-12-04 17:55:07 +01:00
Maciej Bocianski 2ac12028ca Add SingletonPtr test 2017-12-04 11:42:23 +01:00
Russ Butler 1faf46e161 Fix deficiency in the race test
The test for construction of local static objects doesn't check
to see if the object returned has been fully initialized. Because
of this, an error with ARMCC was not detected.

This patch adds an assert to the race_test to ensure that the
object has been properly initialized.
2017-12-01 10:49:50 -06:00
Veijo Pesonen 2d7a79f123 Greentea Wifi testcase fixes
Replace 'TEST_PASS' with 'return'
2017-12-01 16:35:55 +02:00
Przemyslaw Stekiel a488424d26 Add CircularBuffer test. 2017-11-29 11:26:36 +01:00
Wolfgang Betz 043ee4a6f5 Split test for secure & unsecure tests 2017-11-28 13:17:38 +01:00
Wolfgang Betz 3613803a7a Correct WiFi driver name to `X_NUCLEO_IDW0XX1` 2017-11-28 13:17:37 +01:00
Jimmy Brisson 70522bb44b
Merge pull request #5360 from maciejbocianski/thread_fix
threads test adjust to run on devices with small RAM
2017-11-27 10:35:44 -06:00
Veijo Pesonen e488b2c04f Greentea Wifi testcase fixes
ONME-3266 Greentea testcase WIFI-SCAN fails arbitrarily
ONME-3278 Greentea testcase WIFI-SET-CREDENTIAL doesn't try WEP with valid credentials
ONME-3279 Greentea testcase WIFI-GET-RSSI uses arbitrary RSSI value limits
ONME-3280 Greentea testcase WIFI-CONNECT-PARAMS-VALID-SECURE assumes WPA2
2017-11-23 13:57:05 +02:00
Jimmy Brisson cfa9e47aee
Merge pull request #5483 from maciejbocianski/heap_and_stack_tests
heap_and_stack test refactoring
2017-11-22 10:15:03 -06:00
Jimmy Brisson 308833b431
Merge pull request #5323 from maciejbocianski/malloc_tests
malloc test refactoring
2017-11-22 10:14:35 -06:00
Maciej Bocianski bc99556151 threads test: increase threads heap size 2017-11-22 12:54:43 +01:00
Mika Leppänen 5c15819130 Tests for wifi emac interface 2017-11-21 09:52:58 +02:00
Jimmy Brisson 593eab2603
Merge pull request #5123 from maciejbocianski/signal_tests
Extends test set for Thread signals
2017-11-20 10:49:58 -06:00
Maciej Bocianski bc103359f7 heap_and_stack test refactoring 2017-11-20 11:24:49 +01:00
Martin Kojtal 56aa7c396f
Merge pull request #5261 from maciejbocianski/ticker_tests2
Extends test set for Ticker class
2017-11-16 16:23:35 +00:00
Martin Kojtal eb5d3fffff
Merge pull request #5403 from mprse/timer_test_delta_fix
Provide fixes for Timer and LowPowerTimer tests.
2017-11-16 16:19:24 +00:00
Russ Butler 93cf15d57c Fix and add test for ConditionVariable
Fix the circular linked list handling in ConditionVariable and add a
test to validate the linked list implementation.
2017-11-15 16:15:27 -06:00
Martin Kojtal 41eb565d9c
Merge pull request #5342 from ARMmbed/feature_cortex_a
Update CMSIS/RTX with Cortex-A support
2017-11-15 11:24:36 +00:00
Maciej Bocianski a7f31c9cc1 malloc test refactoring 2017-11-15 11:04:40 +01:00
Przemyslaw Stekiel 78e1362ec0 Provide fix for Issue #5468.
Issue: https://github.com/ARMmbed/mbed-os/issues/5468
Increased DELTA value for Timer and Low Power Timer tests.
2017-11-13 11:03:29 +01:00
Przemyslaw Stekiel d962f67ca2 Move Timer test, modify ASERT macros, fix comments.
Move Timer test to TESTS/mbed_drivers/ directory which is more suitable.
Fix few comments which are incorrect.
Use more relevant ASERT macros.
2017-11-13 10:43:26 +01:00
Przemyslaw Stekiel d49899a6e2 Provide fix for Timer and LowPowerTimer tests (time accumulation).
LowPoterTimer test gives sometimes failed result while testing measured time accumulation. The check which verifies if total number of elapsed milliseconds is valid fails. Test assumes that delta value equal to 1 ms is sufficient for all test cases, which is not true since in case where time measurement is performed few times in sequence the measurement error also accumulates and 1 ms might be not enough. To solve this problem delta value for milliseconds tests must be updated.
2017-11-13 10:12:11 +01:00
Bartek Szatkowski 8eebcff166 Disable heap and stack tests for Cortex A
These tests are not compatible with Cortex A due to __get_MSP usage.
2017-11-10 09:53:41 +00:00
Sarah Marsh 8c5c905d95 Limit size of equeue for sigio net test 2017-11-09 17:56:53 -06:00
Martin Kojtal 6713513ce9
Merge pull request #5370 from maciejbocianski/event_queue_mem_fix
event queue test: fix out of memory for NUCLEO_F070RB
2017-11-09 16:40:16 +00:00
Martin Kojtal c45dd269f5
Merge pull request #3648 from c1728p9/condition_variable
Add ConditionVariable to mbed rtos
2017-11-09 16:38:02 +00:00
Martin Kojtal adfe004303
Merge pull request #5425 from fkjagodzinski/test-rtostimer-update
RtosTimer tests update
2017-11-09 16:31:39 +00:00
Maciej Bocianski 0151b1c359 small supplement for PR #5338 2017-11-03 15:32:08 +01:00
Maciej Bocianski f28aef4b01 event queue test: fix out of memory problem for NUCLEO_F070RB 2017-11-03 14:47:20 +01:00
Filip Jagodzinski efbfc5a5b8 Tests: RTOS: RtosTimer: Refactor for readability 2017-11-03 10:57:20 +01:00
Russ Butler d01c7fa626 Add test cases for ConditionVariable
Add basic tests for the ConditionVariable class.
2017-11-02 21:02:37 -05:00
Jimmy Brisson 3a05b63f1e
Merge pull request #5158 from YarivCol/master
RTOS : added empty and full functions to Mail and Queue
2017-11-02 10:46:06 -05:00
Jimmy Brisson d1c65c9243
Merge pull request #5338 from maciejbocianski/malloc_fix
malloc test: fix out of memory problem for NUCLEO_F070RB
2017-11-02 10:42:21 -05:00
Jimmy Brisson 1454e6b54b
Merge pull request #5047 from maciejbocianski/lp_ticker_tests
Test set for LowPowerTicker class
2017-11-02 10:37:00 -05:00
Jimmy Brisson c7b4c7a7ef
Merge pull request #5379 from maciejbocianski/race_mem_fix
race test: fix out of memory problem for NUCLEO_F070RB
2017-11-01 14:05:58 -05:00
Filip Jagodzinski fc27107311 Tests: RTOS: RtosTimer: Fix tests for NRF51_DK board
Additional delay is needed to prevent random failures when
waiting for a semaphore.
2017-10-31 18:19:36 +01:00
Jimmy Brisson 12dace0a4b
Merge pull request #5377 from maciejbocianski/semaphore_mem_fix
semaphore test: fix out of memory problem for NUCLEO_F070RB
2017-10-30 10:11:29 -05:00
Jimmy Brisson 3749f2d469
Merge pull request #5376 from maciejbocianski/mail_mem_fix
mail test: fix out of memory problem for NUCLEO_F070RB
2017-10-30 10:10:47 -05:00
Jimmy Brisson 55197e78f3
Merge pull request #4936 from mprse/memPool_test_and_fixes
Add MemoryPool test.
2017-10-30 10:07:49 -05:00
Maciej Bocianski 6bda5907aa malloc test - reduce heap usage 2017-10-27 14:32:03 +02:00
Przemyslaw Stekiel b7e27760d9 Add MemoryPool test.
Add test for MemoryPool.
2017-10-27 08:07:34 +02:00
Maciej Bocianski adb3dacd9d mail test: fix out of memory problem for NUCLEO_F070RB 2017-10-26 14:33:14 +02:00
Maciej Bocianski 1c39f5b37e semaphore test: fix out of memory problem for NUCLEO_F070RB 2017-10-26 14:32:42 +02:00
Maciej Bocianski e174bd439c Extends test set for signals 2017-10-26 14:13:09 +02:00
Anna Bridge ffb7ae0c9e Merge pull request #5365 from 0xc0170/fix_reduntant_tst
Remove redundant ISR test.
2017-10-26 10:59:50 +01:00
Maciej Bocianski 9bf936cb49 race test: fix out of memory problem for NUCLEO_F070RB 2017-10-25 09:40:05 +02:00
Przemyslaw Stekiel cbd402e426 Remove redundant ISR test. 2017-10-23 17:51:54 +01:00
Maciej Bocianski d231837b48 threads test adjust to run on devices with small RAM 2017-10-23 09:39:48 +02:00
Anna Bridge 9c1fd48529 Merge pull request #5278 from maciejbocianski/heap_and_stack_tests
Move heap_and_stack tests to TESTS/mbed_bootstrap
2017-10-20 10:25:07 +01:00
Anna Bridge 4d25bccbb1 Merge pull request #5081 from maciejbocianski/events_flags_tests
Extends test set for EventFlags class
2017-10-20 10:24:31 +01:00
Martin Kojtal cbb8a1f994 Merge pull request #4947 from fkjagodzinski/rtostimer_tests
Rtostimer tests
2017-10-19 16:46:12 +01:00
Martin Kojtal 919e145bde Merge pull request #5243 from maciejbocianski/basic_tests
Basic test refactoring
2017-10-19 16:43:49 +01:00
Maciej Bocianski aaa15bcf58 Extends test set for Ticker class (round 2) 2017-10-19 15:12:44 +02:00
Przemyslaw Stekiel 5a833ffd0a Add fix for Timer test - provide missing get_info ticker interface function 2017-10-17 10:47:51 +02:00
Jimmy Brisson 23be7a814d Merge pull request #5074 from mprse/lp_timer_test
Add Low Power Timer test.
2017-10-13 09:21:46 -05:00
Jimmy Brisson 84f2d089f4 Merge pull request #5147 from 0xc0170/fix_deepsleep_tests
Test: deepsleep() API replacement
2017-10-13 09:19:41 -05:00
Jimmy Brisson fad67559ae Merge pull request #5028 from c1728p9/ticker_api_changes
Update ticker to map closely to hardware
2017-10-13 09:18:02 -05:00
Jimmy Brisson bf9c507467 Merge pull request #4971 from mprse/test_timer
Add test for Timer class.
2017-10-13 09:17:31 -05:00
Maciej Bocianski 9ab2a1df32 Move heap_and_stack tests 2017-10-13 08:23:55 +02:00
Maciej Bocianski 9fb4fd017a Test set for LowPowerTicker class 2017-10-11 15:01:15 +02:00
Przemyslaw Stekiel 34a03267d8 Add Low Power Timer test. 2017-10-11 14:55:34 +02:00
Maciej Bocianski 0e014c9bc7 Extends test set for EventFlags class 2017-10-11 11:02:09 +02:00
Jimmy Brisson df88a9dcc2 Merge pull request #5272 from studavekar/echo_test_fix_handshake
Fix echo test handshake and reduce uart load
2017-10-09 13:05:03 -05:00
Jimmy Brisson 42532d7806 Merge pull request #5161 from SeppoTakalo/wifi_tests
Implement functional Wifi tests
2017-10-09 11:13:37 -05:00
Martin Kojtal 943fc32c73 Merge pull request #5255 from c1728p9/fix_ticker_test
Prevent use of deleted ticker in Ticker test
2017-10-09 14:05:22 +01:00