Commit Graph

213 Commits (ac21ee90a88ef6530a173b27d91ff91b6fe956dd)

Author SHA1 Message Date
Kimmo Vaisanen b6ebfeea2c Cellular: Remove old deprecated tests
Cellular tests have been replaced with generic mbed-os netsocket and network interface tests.
2019-10-03 10:24:12 +03:00
Michal Paszta 3297445ac2 Increase the timeout for DNS tests as their number increased 2019-10-01 15:14:44 +03:00
Michal Paszta d6b77da270 Increase timeout in DNS_TIMEOUTS test for ESP8266
The test floods the device with UDP requests (it skips the 100 ms delay to simulate instant timeout). ESP8266 starts responding with "busy p..." message. It needs more time to process the data and recover for subsequent tests.
2019-10-01 15:14:25 +03:00
Antti Kauppila f0eba17ca2 Added missing include 2019-09-30 14:50:26 +03:00
Antti Kauppila f26074c7be Added missing include + cleaned up some tests 2019-09-27 11:13:20 +03:00
Kimmo Vaisanen 986204f269 Fix TLSSocket tests
- set certs and keys after socket open() as required by offloaded TLSSocket
- Added more checks for invalid handshake test and removed google.com test as
  as some modems (e.g. BG96) might contains root CA for google.com
2019-09-25 09:25:33 +03:00
Antti Kauppila 6adc2440a3 DNS manual cleanup mechanism added 2019-09-20 10:20:48 +03:00
Martin Kojtal e134b22dab
Merge pull request #11473 from michalpasztamobica/gcc_warnings_fixes
Fix compilation warnings from GCC in netsocket/network tests
2019-09-19 10:36:16 +02:00
Martin Kojtal 926ffb0ede
Merge pull request #11440 from mtomczykmobica/ONME-4239
Add missing documentation about tls testing
2019-09-18 11:23:38 +02:00
Michal Paszta 9ce69b6f7d Fix compilation warnings from GCC 2019-09-16 12:11:26 +03:00
Marcin Tomczyk df8e3c87fe Add missing documentation about tls testing - review comments fixes 2019-09-12 07:51:30 +02:00
Amanda Butler 4c3cca028e
Edit README.md
Edit document.
2019-09-10 15:20:55 -05:00
Marcin Tomczyk da8dbca561 Add missing documentation about tls testing 2019-09-09 11:54:19 +02:00
Tymoteusz Bloch 126ac1e559 DNS cache synchronous fix - Non zero TTL test server change 2019-09-05 17:21:33 +02:00
Michal Paszta 05e94afca3 Replace TEST_ASSERT_INT_WITHIN usage in netsocket tests
IPCore's netsocket tests are expected to run all tests even if some of them fail. The TEST_ASSERT_INT_WITHIN macro sets a global variable Unity.CurrentTestFailed which prevents further checks and gives incorrect failure count. Other assertion macros in Unity do not do that.
2019-08-22 14:32:59 +03:00
Teppo Järvelin 65bf17eff5 Fix netsocket tests for IAR
Test case printed IP address. If ip address is null, IAR compiled binary fails.
Added check for printing null. If IP address is null, then it prints string 'null'.
2019-08-15 15:26:36 +03:00
Teppo Järvelin ce36104ab3 Fix netsocket DNS test for IAR
Test case printed IP address. If ip address is null, IAR compiled binary fails.
Added check for printing null. If IP address is null, then it prints string 'null'.
2019-08-12 09:39:41 +03:00
Seppo Takalo 818c1d6f0f
Merge pull request #11130 from Tharazi97/NotSupportedTest
Updated testcases
2019-08-02 13:27:54 +03:00
int_szyk ae6f8be146 Newline at the end of files 2019-08-01 08:44:58 +02:00
int_szyk 8b68a1ea58 Updated testcases 2019-07-31 10:46:38 +02:00
Ari Parkkila 71c7ed2fb4 Cellular: Add BG96 AT driver with DNS support 2019-07-31 00:19:05 -07:00
Kevin Bracey a522dcfa0a Replace deprecated wait calls 2019-07-15 10:13:50 +03:00
Tymoteusz Bloch c22350589d UDPSOCKET_ECHOTEST_NONBLOCK performance improvement. 2019-06-10 11:20:12 +02:00
Martin Kojtal dd77957d45
Merge pull request #10665 from tymoteuszblochmobica/json
Add hardcoded Echo server defaults for Greentea socket tests.
2019-06-09 18:05:03 +01:00
Kevin Bracey 2fbbd9d2ca Introduce Semaphore::acquire methods
Deprecate wait() in favour of acquire(), try_acquire(),
try_acquire_for() and try_acquire_until().

Brings Semaphore more into line with CMSIS-RTOS 2 (which uses "acquire"),
itself (as it has "release"), and other classes having "try", "try for"
and "try until".

Also steps away from vague "wait" term - the primary operation here is
to acquire the semaphore, and this will of course sleep.
2019-05-28 17:02:06 +03:00
Tymoteusz Bloch d42ed4e6a9 Added hardcoded Echo server defaults for Greentea socket tests. 2019-05-27 14:41:17 +02:00
Mirela Chirica 26facc7f9b Cellular: WISE-1570 needs greater receiving timeout to pass UDPSOCKET_ECHOTEST_NONBLOCK test
Reason for needing greater timeout could be this test's performance.
UDPSOCKET_ECHOTEST_BURST_NONBLOCK is implementing the receiving
differently and is passing with 1 second timeout.
2019-05-08 10:43:08 +03:00
Michal Paszta d1017ea274 UDPSOCKET_ECHOTEST fails if a packet of any given size was not sent at least once 2019-04-18 11:38:11 +03:00
Martin Kojtal 79dddf84f0
Merge pull request #10381 from michalpasztamobica/echotests_loop_fix
ECHOTEST internal loop simplification and fix
2019-04-16 08:45:25 +01:00
Michal Paszta 631540a421 ECHOTEST internal loop simplification and fix
The loop was wrongly incrementing the index of the array after assiging
the value. Thus the first array element was used twice and the last one
was never user. The issue is fixed and the loops are refactored and
simplified to avoid such confusion in the future.
2019-04-15 11:54:03 +03:00
Tymoteusz Bloch 42b5680697 Multihoming fixed according to new LWIP implementation. 2019-04-11 20:54:48 -05:00
Michal Paszta 872edd4964 Relax TLSSOCKET_RECV_TIMEOUT sigio timeout 2019-04-08 12:56:41 +03:00
Michal Paszta 3505923d02 Test udpsocket_recv_timeout does not check packet reception ratio 2019-04-08 12:56:29 +03:00
Anna Bridge 0f6a8357e7
Merge pull request #10037 from michalpasztamobica/tcp_skip_if_unsupported
TCP/TLS Socket tests will skip if TCP is not supported
2019-03-29 13:30:37 +00:00
Michal Paszta 09183c94b9 TCP/TLS Socket tests will skip if TCP is not supported 2019-03-28 10:08:53 +02:00
Michal Paszta 266d4c43a2 Handle oversized packets in tcp, tls and udp socket tests 2019-03-27 11:01:16 +02:00
Cruz Monrreal d26fe0fe55
Merge pull request #10184 from mirelachirica/wise_1570_udp_echotest_nonblocking
Cellular: Increase receiving timeout for UDP echo non-blocking test
2019-03-27 00:34:47 -05:00
Mirela Chirica ec3c6f37f9 Cellular: WISE-1570 needs greater receiving timeout to pass UDPSOCKET_ECHOTEST_NONBLOCK test
Reason for needing greater timeout could be this test's performance.
UDPSOCKET_ECHOTEST_BURST_NONBLOCK is implementing the receiving
differently and is passing with 1 second timeout.
2019-03-26 09:10:02 +02:00
Martin Kojtal db8a018fec
Merge pull request #9959 from michalpasztamobica/refactor_socket_stats_usage
Refactor socket stats to reduce boiler plate
2019-03-21 10:46:15 +01:00
Cruz Monrreal dbb33ef423
Merge pull request #9801 from vmedcy/fix-eventqueue-h
Correctly include EventQueue.h
2019-03-16 22:52:40 -05:00
Martin Kojtal 91b81c65fb
Merge pull request #9905 from michalpasztamobica/test_recv_return_less_or_equal
Tests: check if recv returned too much data
2019-03-15 14:57:01 +01:00
Michal Paszta b7ed4b5d9e Refactor socket stats to reduce bioler plate
Add a proper test case setup and teardown which does the socket stats
checks in tcp, udp and tls.
2019-03-14 11:09:35 +02:00
kegilbert 194fa129fb Update recently added previous macro name uses in tests 2019-03-01 13:53:47 -06:00
Michal Paszta c81f71b2de Tests: check if recv returned too much data 2019-03-01 18:01:38 +02:00
Martin Kojtal b08ddaad8b
Merge pull request #9794 from michalpasztamobica/greentea_tcpsocket_sigio
Refactor tcpsocket tests to use sigio and not to wait
2019-02-26 10:30:56 +01:00
Cruz Monrreal 044d0c9cb1
Merge pull request #9778 from michalpasztamobica/add_missing_wifi_config_params
Add missing wifi parameters to test configs
2019-02-25 17:30:36 -06:00
Michal Paszta 999273f7e5 Refactor tcpsocket tests to use sigio and not to wait 2019-02-25 15:33:09 +02:00
Michal Paszta 19c6732105 Add missing wifi parameters to test configs 2019-02-22 10:13:14 +02:00
Volodymyr Medvid b0a33273ff Correctly include EventQueue.h
There are two EventQueue.h in mbed-os codebase:
events/EventQueue.h
features/FEATURE_BLE/ble/pal/EventQueue.h

By accident, `mbed compile` generates includes.txt with the correct
order of include search paths. This is not the case for the CMake
exporter: targets with FEATURE_BLE enables fail to compile with errors:

mbed-os/features/cellular/framework/AT/ATHandler.h:99:60: error:
'events' has not been declared

Update all places to always include either "events/EventQueue.h"
or "ble/pal/EventQueue.h": to always find the correct header.
2019-02-21 17:59:05 +02:00
Cruz Monrreal b59b8170a6
Merge pull request #9698 from michalpasztamobica/netsocket_documentation_cleanup
Netsocket documentation cleanup
2019-02-19 15:34:26 -06:00
Cruz Monrreal 4cbcc36c3c
Merge pull request #9730 from michalpasztamobica/tlssocketsimultaneous_temporary_removal
Greentea: Remove TLSSocket_simultaneous test
2019-02-19 14:56:02 -06:00
Michal Paszta 5eaf08e899 Netsocket documentation cleanup 2019-02-18 10:40:42 +02:00
Michal Paszta ca57bdd481 Greentea tests: user-configurable timeouts
Now it is enough to add:
    "macros": [
        "MBED_GREENTEA_TEST_XXXSOCKET_TIMEOUT_S=20"
    ],
to mbed_app.json, where XXX is on of {DNS, TLS, UDP, TCP}.
Also network-* tests are now configurable: network-interface, network-wifi, network-emac with a similar macro.
2019-02-15 15:08:15 +02:00
Michal Paszta a089661f05 Greentea: Remove TLSSocket_simultaneous test
The reason is that some platforms lack memory to run it. To be brought
back once TLS library memory consumption is optimized.
2019-02-15 11:59:28 +02:00
Cruz Monrreal 2e9d6d2938
Merge pull request #9645 from AriParkkila/cellular-netsocket
Change TESTS/netsocket/ for cellular testing
2019-02-13 17:28:35 -06:00
Ari Parkkila 56badd8616 Change TESTS/netsocket/ for cellular testing 2019-02-13 01:30:42 -08:00
Michal Paszta b5c00aa6b7 Greentea tests: set correct port to test against google.com 2019-02-12 15:40:11 +02:00
Martin Kojtal 091509705f
Merge pull request #9570 from VeijoPesonen/bugfix-tests-netsocket-udp_udpsocket_echotest_nonblock
tests-netsocket-udp: UDPSOCKET_ECHOTEST_NONBLOCK fixes
2019-02-12 09:55:20 +01:00
Cruz Monrreal 799476dd55
Merge pull request #9630 from michalpasztamobica/publish_documentation
Publish tests documentation for DNS, Emac, NetworkInterface and Wifi
2019-02-11 18:47:55 -06:00
Cruz Monrreal 5c4d5e346d
Merge pull request #9582 from michalpasztamobica/greentea_socket_improvements
Greentea Socket test improvements
2019-02-11 18:45:38 -06:00
Veijo Pesonen ba75924c28 tests-netsocket-tls: TLSSOCKET_ECHOTEST deletes socket on failure case 2019-02-07 12:01:09 +02:00
Michal Paszta ea3d70e0b1 Publish tests documentation for DNS, Emac, NetworkInterface and Wifi
Documentation moved from internal Confluence pages.
2019-02-06 16:22:21 +02:00
Veijo Pesonen df3cdaa983 tests-netsocket-udp: UDPSOCKET_ECHOTEST_NONBLOCK execution time limit
Test case is allowed to take not more than a half what has been given
to the whole UDP suite.

UDP test cases reorganized so that the longest running ones are
executed last.
2019-02-04 12:33:34 +02:00
Michal Paszta b3fd8a9bef Greentea DNS test: added debug print 2019-02-01 15:34:38 +02:00
Michal Paszta 99fc26ecdf Greentea Socket bind tests made ipv6-aware 2019-02-01 15:34:07 +02:00
Michal Paszta fba66cf7f3 Greentea UDPSOCKET_RECV_TIMEOUT increase time tolerance 2019-02-01 14:22:05 +02:00
Martin Kojtal 3d4582bda0
Merge pull request #9572 from michalpasztamobica/greentea_tls_ipv6_compliant_website
Use an ip4- and ip6-compliant site to test TLS certificate error reporting
2019-02-01 08:26:08 +01:00
Cruz Monrreal 2c5d246249
Merge pull request #9429 from SeppoTakalo/TCPSOCKET_endpoint_close
Fix TCPSOCKET_ENDPOINT_CLOSE: Cannot accept WOULD_BLOCK
2019-01-31 10:20:20 -06:00
Michal Paszta c3f3dcbc0e Use an ip4- and ip6-compliant site to test TLS certificate error reporting 2019-01-31 15:00:13 +02:00
Veijo Pesonen 4d31455a0f tests-netsocket-udp: UDPSOCKET_ECHOTEST_NONBLOCK restores non-blocking
Fixes a bug where after dropping bad packets receiver doesn't restore
the socket back to non-blocking state as it's supposed to.
2019-01-31 12:59:40 +02:00
Martin Kojtal a4ed473afc
Merge pull request #9515 from VeijoPesonen/bugfix-tests-netsocket-udp_udpsocket_sendto_invalid
tests-netsocket-udp UDPSOCKET_SENDTO_INVALID allow unsupported empty UDP packet
2019-01-30 10:08:34 +01:00
Veijo Pesonen b0fca1ffc8 Test UDPSOCKET_SENDTO_INVALID allows NSAPI_ERROR_UNSUPPORTED 2019-01-29 10:59:06 +02:00
Michal Paszta af65522652 Publish TLSSocket test documentation
The whole README.md had to be updated to match the internal Confluence documentation, which can now be locked. In the process I also updated any spotted mistakes in tests documentation, removed the obsolete TCPServer tests documentation and added a test which was missing from UDPSocket's main.
2019-01-23 16:54:19 +02:00
Michal Paszta d568e2160b Add TLSSocket greentea tests.
TLSSocket tests based on existing TCPSocket greentea tests and TLSSocket icetea tests.
2019-01-22 12:46:48 +01:00
Martin Kojtal 7b29593a41
Merge pull request #9415 from SeppoTakalo/ONME-4140
Allow NSAPI_ERROR_UNSUPPORTED from Socket::setsockopt()
2019-01-21 13:43:37 +01:00
Martin Kojtal 5c46faeb86
Merge pull request #9417 from jeromecoutant/PR_DNSTIMEOUT
Netsocket DNS test: increase timeout value
2019-01-21 13:42:24 +01:00
Seppo Takalo 6b92d32b3e Fix TCPSOCKET_ENDPOINT_CLOSE: Cannot accept WOULD_BLOCK
This testcase uses Socket in blocking mode, and therefore
WOULD_BLOCK should not be accepted.
The logic was wrong anyway, because return value was tested
to be negative before testing with WOULD_BLOCK which is negative
as well.

Also replaced TEST_FAIL() macro with TEST_ASSERT_EQUAL() to
make the return code visible in test log.
2019-01-21 10:46:11 +02:00
Cruz Monrreal 68deb05d1b
Merge pull request #9376 from michalpasztamobica/tcpsocket_greentea
TCP/UDP greentea tests refactoring and cleanup
2019-01-17 21:52:40 -06:00
jeromecoutant 3a190656fa Netsocket DNS test: increase timeout value 2019-01-17 17:39:43 +01:00
Seppo Takalo 26dcd0d90a Allow NSAPI_ERROR_UNSUPPORTED from Socket::setsockopt() 2019-01-17 18:02:04 +02:00
Michal Paszta 6e629e1ba6 Gemalto Crinterion UDP test adjustments
Adjusting the tests to match the cellular modems ELS61-E2 and BGS2-W requirements.
2019-01-15 12:38:48 +01:00
Michal Paszta 59e8dedb67 TCP/UDP greentea tests refactoring and cleanup 2019-01-15 10:00:35 +01:00
Martin Kojtal cc89c20abc
Merge pull request #9175 from michalpasztamobica/greentea_ignore_unsupported
Greentea tests ignore bind returning UNSUPPORTED
2019-01-03 14:59:50 +00:00
Michal Paszta a2110d5411 Greentea tests ignore bind returning UNSUPPORTED 2018-12-20 15:38:07 +01:00
Seppo Takalo 18404e93be Drop MBED_EXTENTED_TESTS flagging from network tests.
All properly working IP stacks are required to pass Mbed OS socket tests.
This have now proven with current Ethernet devices with LwIP stack.
2018-12-19 16:18:33 +02:00
jeromecoutant bd4b99c498 DNS tests: improve debug messages 2018-12-18 13:32:45 +01:00
Kari Haapalehto e502675bd1 Fix test-netsocket-tcp greentea test build fails.
main.cpp was missing comma at the end of line.
2018-12-11 12:51:30 +02:00
Michal Paszta c48312ded4 Missing socket greentea tests implementation 2018-12-07 10:35:39 +01:00
deepikabhavnani c272377a81 Make sure no memory overhead if statistics are disabled 2018-11-26 09:42:45 -06:00
deepikabhavnani 068f2d14c0 Resolve IAR build issue
IAR not able to assign default zero value in array and complaints of
internal error as below:

[ERROR] Internal error: [Front end]: assertion failed at:
"..\..\Translator\compiler_core\src\parser\edg\decl_inits.c", line 2031
2018-11-26 09:42:45 -06:00
deepikabhavnani 117eb0bc87 Add socketstats stub functions for unittest and addressed reviews 2018-11-26 09:42:50 -06:00
Deepika f6c1a40b29 Add config options for socket statistics
1. MBED_CONF_NSAPI_SOCKET_STATS_ENABLE to enable the statistics
2. MBED_CONF_NSAPI_SOCKET_STATS_MAX_COUNT max sockets statistics cached
2018-11-26 09:42:45 -06:00
Deepika a851df66e3 Code/bug after testing
1. Fixing astyle and docs
2. Extra mutex lock was removed
3. Bytes are updated when send/recv > 0 and not in case of -ve error
4. Review comments
5. Guard statistics implementation in test with MBED_NW_STATS_ENABLED
2018-11-26 09:42:45 -06:00
Deepika eec54a0fc9 Update tcp test cases to verify network socket statistics
Cases Updated are:
1. TCPSOCKET_ECHOTEST_NONBLOCK
2. TCPSOCKET_OPEN_CLOSE_REPEAT
3. TCPSOCKET_OPEN_LIMIT
2018-11-26 09:42:45 -06:00
Deepika e7ea2927fc Update udp test cases to verify network socket statistics
Cases Updated are:
1. UDPSOCKET_ECHOTEST_NONBLOCK
2. UDPSOCKET_OPEN_CLOSE_REPEAT
3. UDPSOCKET_OPEN_LIMIT
2018-11-26 09:42:45 -06:00
Martin Kojtal c873dc06f2 Merge branch 'ONME-3983' of https://github.com/mtomczykmobica/mbed-os into dev_rollup 2018-11-24 21:14:47 +00:00
Michal Paszta e53ee631f9 Greentea netsocket and network tests improvements
Added smarter rounding of times in recv_timeout and increased the delta by one, to allow "off-by-one" errors.
Reverted commit 88eea6a, reducing TESTS_TIMEOUT back to 480.
Introduced a 100ms timeout for waiting on asynchronous DNS resolution.
Improved error handling on disconnects.
2018-11-19 08:58:14 +01:00
Marcin Tomczyk d3812f3740 ONME-3983 Fix the defects found in IPV4 testing against packet dropping 2018-11-15 13:47:43 +01:00
Marcin Tomczyk 5eabfabc51 ONME-3733 detect xinetd service pattern and generate correct pattern 2018-11-07 13:18:04 +01:00
Seppo Takalo 66a2101006 Continue Socket and WiFi tests even on test failure.
Purpose is to run full set of testcases on each run.
Testcases should contain proper cleanup handlers so that they are
independent.
2018-10-23 13:58:21 +03:00