Commit Graph

191 Commits (cf5944186eaf93eef441a0197a1196979f95b31b)

Author SHA1 Message Date
Tymoteusz Bloch c22350589d UDPSOCKET_ECHOTEST_NONBLOCK performance improvement. 2019-06-10 11:20:12 +02:00
Martin Kojtal dd77957d45
Merge pull request #10665 from tymoteuszblochmobica/json
Add hardcoded Echo server defaults for Greentea socket tests.
2019-06-09 18:05:03 +01:00
Kevin Bracey 2fbbd9d2ca Introduce Semaphore::acquire methods
Deprecate wait() in favour of acquire(), try_acquire(),
try_acquire_for() and try_acquire_until().

Brings Semaphore more into line with CMSIS-RTOS 2 (which uses "acquire"),
itself (as it has "release"), and other classes having "try", "try for"
and "try until".

Also steps away from vague "wait" term - the primary operation here is
to acquire the semaphore, and this will of course sleep.
2019-05-28 17:02:06 +03:00
Tymoteusz Bloch d42ed4e6a9 Added hardcoded Echo server defaults for Greentea socket tests. 2019-05-27 14:41:17 +02:00
Mirela Chirica 26facc7f9b Cellular: WISE-1570 needs greater receiving timeout to pass UDPSOCKET_ECHOTEST_NONBLOCK test
Reason for needing greater timeout could be this test's performance.
UDPSOCKET_ECHOTEST_BURST_NONBLOCK is implementing the receiving
differently and is passing with 1 second timeout.
2019-05-08 10:43:08 +03:00
Michal Paszta d1017ea274 UDPSOCKET_ECHOTEST fails if a packet of any given size was not sent at least once 2019-04-18 11:38:11 +03:00
Martin Kojtal 79dddf84f0
Merge pull request #10381 from michalpasztamobica/echotests_loop_fix
ECHOTEST internal loop simplification and fix
2019-04-16 08:45:25 +01:00
Michal Paszta 631540a421 ECHOTEST internal loop simplification and fix
The loop was wrongly incrementing the index of the array after assiging
the value. Thus the first array element was used twice and the last one
was never user. The issue is fixed and the loops are refactored and
simplified to avoid such confusion in the future.
2019-04-15 11:54:03 +03:00
Tymoteusz Bloch 42b5680697 Multihoming fixed according to new LWIP implementation. 2019-04-11 20:54:48 -05:00
Michal Paszta 872edd4964 Relax TLSSOCKET_RECV_TIMEOUT sigio timeout 2019-04-08 12:56:41 +03:00
Michal Paszta 3505923d02 Test udpsocket_recv_timeout does not check packet reception ratio 2019-04-08 12:56:29 +03:00
Anna Bridge 0f6a8357e7
Merge pull request #10037 from michalpasztamobica/tcp_skip_if_unsupported
TCP/TLS Socket tests will skip if TCP is not supported
2019-03-29 13:30:37 +00:00
Michal Paszta 09183c94b9 TCP/TLS Socket tests will skip if TCP is not supported 2019-03-28 10:08:53 +02:00
Michal Paszta 266d4c43a2 Handle oversized packets in tcp, tls and udp socket tests 2019-03-27 11:01:16 +02:00
Cruz Monrreal d26fe0fe55
Merge pull request #10184 from mirelachirica/wise_1570_udp_echotest_nonblocking
Cellular: Increase receiving timeout for UDP echo non-blocking test
2019-03-27 00:34:47 -05:00
Mirela Chirica ec3c6f37f9 Cellular: WISE-1570 needs greater receiving timeout to pass UDPSOCKET_ECHOTEST_NONBLOCK test
Reason for needing greater timeout could be this test's performance.
UDPSOCKET_ECHOTEST_BURST_NONBLOCK is implementing the receiving
differently and is passing with 1 second timeout.
2019-03-26 09:10:02 +02:00
Martin Kojtal db8a018fec
Merge pull request #9959 from michalpasztamobica/refactor_socket_stats_usage
Refactor socket stats to reduce boiler plate
2019-03-21 10:46:15 +01:00
Cruz Monrreal dbb33ef423
Merge pull request #9801 from vmedcy/fix-eventqueue-h
Correctly include EventQueue.h
2019-03-16 22:52:40 -05:00
Martin Kojtal 91b81c65fb
Merge pull request #9905 from michalpasztamobica/test_recv_return_less_or_equal
Tests: check if recv returned too much data
2019-03-15 14:57:01 +01:00
Michal Paszta b7ed4b5d9e Refactor socket stats to reduce bioler plate
Add a proper test case setup and teardown which does the socket stats
checks in tcp, udp and tls.
2019-03-14 11:09:35 +02:00
kegilbert 194fa129fb Update recently added previous macro name uses in tests 2019-03-01 13:53:47 -06:00
Michal Paszta c81f71b2de Tests: check if recv returned too much data 2019-03-01 18:01:38 +02:00
Martin Kojtal b08ddaad8b
Merge pull request #9794 from michalpasztamobica/greentea_tcpsocket_sigio
Refactor tcpsocket tests to use sigio and not to wait
2019-02-26 10:30:56 +01:00
Cruz Monrreal 044d0c9cb1
Merge pull request #9778 from michalpasztamobica/add_missing_wifi_config_params
Add missing wifi parameters to test configs
2019-02-25 17:30:36 -06:00
Michal Paszta 999273f7e5 Refactor tcpsocket tests to use sigio and not to wait 2019-02-25 15:33:09 +02:00
Michal Paszta 19c6732105 Add missing wifi parameters to test configs 2019-02-22 10:13:14 +02:00
Volodymyr Medvid b0a33273ff Correctly include EventQueue.h
There are two EventQueue.h in mbed-os codebase:
events/EventQueue.h
features/FEATURE_BLE/ble/pal/EventQueue.h

By accident, `mbed compile` generates includes.txt with the correct
order of include search paths. This is not the case for the CMake
exporter: targets with FEATURE_BLE enables fail to compile with errors:

mbed-os/features/cellular/framework/AT/ATHandler.h:99:60: error:
'events' has not been declared

Update all places to always include either "events/EventQueue.h"
or "ble/pal/EventQueue.h": to always find the correct header.
2019-02-21 17:59:05 +02:00
Cruz Monrreal b59b8170a6
Merge pull request #9698 from michalpasztamobica/netsocket_documentation_cleanup
Netsocket documentation cleanup
2019-02-19 15:34:26 -06:00
Cruz Monrreal 4cbcc36c3c
Merge pull request #9730 from michalpasztamobica/tlssocketsimultaneous_temporary_removal
Greentea: Remove TLSSocket_simultaneous test
2019-02-19 14:56:02 -06:00
Michal Paszta 5eaf08e899 Netsocket documentation cleanup 2019-02-18 10:40:42 +02:00
Michal Paszta ca57bdd481 Greentea tests: user-configurable timeouts
Now it is enough to add:
    "macros": [
        "MBED_GREENTEA_TEST_XXXSOCKET_TIMEOUT_S=20"
    ],
to mbed_app.json, where XXX is on of {DNS, TLS, UDP, TCP}.
Also network-* tests are now configurable: network-interface, network-wifi, network-emac with a similar macro.
2019-02-15 15:08:15 +02:00
Michal Paszta a089661f05 Greentea: Remove TLSSocket_simultaneous test
The reason is that some platforms lack memory to run it. To be brought
back once TLS library memory consumption is optimized.
2019-02-15 11:59:28 +02:00
Cruz Monrreal 2e9d6d2938
Merge pull request #9645 from AriParkkila/cellular-netsocket
Change TESTS/netsocket/ for cellular testing
2019-02-13 17:28:35 -06:00
Ari Parkkila 56badd8616 Change TESTS/netsocket/ for cellular testing 2019-02-13 01:30:42 -08:00
Michal Paszta b5c00aa6b7 Greentea tests: set correct port to test against google.com 2019-02-12 15:40:11 +02:00
Martin Kojtal 091509705f
Merge pull request #9570 from VeijoPesonen/bugfix-tests-netsocket-udp_udpsocket_echotest_nonblock
tests-netsocket-udp: UDPSOCKET_ECHOTEST_NONBLOCK fixes
2019-02-12 09:55:20 +01:00
Cruz Monrreal 799476dd55
Merge pull request #9630 from michalpasztamobica/publish_documentation
Publish tests documentation for DNS, Emac, NetworkInterface and Wifi
2019-02-11 18:47:55 -06:00
Cruz Monrreal 5c4d5e346d
Merge pull request #9582 from michalpasztamobica/greentea_socket_improvements
Greentea Socket test improvements
2019-02-11 18:45:38 -06:00
Veijo Pesonen ba75924c28 tests-netsocket-tls: TLSSOCKET_ECHOTEST deletes socket on failure case 2019-02-07 12:01:09 +02:00
Michal Paszta ea3d70e0b1 Publish tests documentation for DNS, Emac, NetworkInterface and Wifi
Documentation moved from internal Confluence pages.
2019-02-06 16:22:21 +02:00
Veijo Pesonen df3cdaa983 tests-netsocket-udp: UDPSOCKET_ECHOTEST_NONBLOCK execution time limit
Test case is allowed to take not more than a half what has been given
to the whole UDP suite.

UDP test cases reorganized so that the longest running ones are
executed last.
2019-02-04 12:33:34 +02:00
Michal Paszta b3fd8a9bef Greentea DNS test: added debug print 2019-02-01 15:34:38 +02:00
Michal Paszta 99fc26ecdf Greentea Socket bind tests made ipv6-aware 2019-02-01 15:34:07 +02:00
Michal Paszta fba66cf7f3 Greentea UDPSOCKET_RECV_TIMEOUT increase time tolerance 2019-02-01 14:22:05 +02:00
Martin Kojtal 3d4582bda0
Merge pull request #9572 from michalpasztamobica/greentea_tls_ipv6_compliant_website
Use an ip4- and ip6-compliant site to test TLS certificate error reporting
2019-02-01 08:26:08 +01:00
Cruz Monrreal 2c5d246249
Merge pull request #9429 from SeppoTakalo/TCPSOCKET_endpoint_close
Fix TCPSOCKET_ENDPOINT_CLOSE: Cannot accept WOULD_BLOCK
2019-01-31 10:20:20 -06:00
Michal Paszta c3f3dcbc0e Use an ip4- and ip6-compliant site to test TLS certificate error reporting 2019-01-31 15:00:13 +02:00
Veijo Pesonen 4d31455a0f tests-netsocket-udp: UDPSOCKET_ECHOTEST_NONBLOCK restores non-blocking
Fixes a bug where after dropping bad packets receiver doesn't restore
the socket back to non-blocking state as it's supposed to.
2019-01-31 12:59:40 +02:00
Martin Kojtal a4ed473afc
Merge pull request #9515 from VeijoPesonen/bugfix-tests-netsocket-udp_udpsocket_sendto_invalid
tests-netsocket-udp UDPSOCKET_SENDTO_INVALID allow unsupported empty UDP packet
2019-01-30 10:08:34 +01:00
Veijo Pesonen b0fca1ffc8 Test UDPSOCKET_SENDTO_INVALID allows NSAPI_ERROR_UNSUPPORTED 2019-01-29 10:59:06 +02:00
Michal Paszta af65522652 Publish TLSSocket test documentation
The whole README.md had to be updated to match the internal Confluence documentation, which can now be locked. In the process I also updated any spotted mistakes in tests documentation, removed the obsolete TCPServer tests documentation and added a test which was missing from UDPSocket's main.
2019-01-23 16:54:19 +02:00
Michal Paszta d568e2160b Add TLSSocket greentea tests.
TLSSocket tests based on existing TCPSocket greentea tests and TLSSocket icetea tests.
2019-01-22 12:46:48 +01:00
Martin Kojtal 7b29593a41
Merge pull request #9415 from SeppoTakalo/ONME-4140
Allow NSAPI_ERROR_UNSUPPORTED from Socket::setsockopt()
2019-01-21 13:43:37 +01:00
Martin Kojtal 5c46faeb86
Merge pull request #9417 from jeromecoutant/PR_DNSTIMEOUT
Netsocket DNS test: increase timeout value
2019-01-21 13:42:24 +01:00
Seppo Takalo 6b92d32b3e Fix TCPSOCKET_ENDPOINT_CLOSE: Cannot accept WOULD_BLOCK
This testcase uses Socket in blocking mode, and therefore
WOULD_BLOCK should not be accepted.
The logic was wrong anyway, because return value was tested
to be negative before testing with WOULD_BLOCK which is negative
as well.

Also replaced TEST_FAIL() macro with TEST_ASSERT_EQUAL() to
make the return code visible in test log.
2019-01-21 10:46:11 +02:00
Cruz Monrreal 68deb05d1b
Merge pull request #9376 from michalpasztamobica/tcpsocket_greentea
TCP/UDP greentea tests refactoring and cleanup
2019-01-17 21:52:40 -06:00
jeromecoutant 3a190656fa Netsocket DNS test: increase timeout value 2019-01-17 17:39:43 +01:00
Seppo Takalo 26dcd0d90a Allow NSAPI_ERROR_UNSUPPORTED from Socket::setsockopt() 2019-01-17 18:02:04 +02:00
Michal Paszta 6e629e1ba6 Gemalto Crinterion UDP test adjustments
Adjusting the tests to match the cellular modems ELS61-E2 and BGS2-W requirements.
2019-01-15 12:38:48 +01:00
Michal Paszta 59e8dedb67 TCP/UDP greentea tests refactoring and cleanup 2019-01-15 10:00:35 +01:00
Martin Kojtal cc89c20abc
Merge pull request #9175 from michalpasztamobica/greentea_ignore_unsupported
Greentea tests ignore bind returning UNSUPPORTED
2019-01-03 14:59:50 +00:00
Michal Paszta a2110d5411 Greentea tests ignore bind returning UNSUPPORTED 2018-12-20 15:38:07 +01:00
Seppo Takalo 18404e93be Drop MBED_EXTENTED_TESTS flagging from network tests.
All properly working IP stacks are required to pass Mbed OS socket tests.
This have now proven with current Ethernet devices with LwIP stack.
2018-12-19 16:18:33 +02:00
jeromecoutant bd4b99c498 DNS tests: improve debug messages 2018-12-18 13:32:45 +01:00
Kari Haapalehto e502675bd1 Fix test-netsocket-tcp greentea test build fails.
main.cpp was missing comma at the end of line.
2018-12-11 12:51:30 +02:00
Michal Paszta c48312ded4 Missing socket greentea tests implementation 2018-12-07 10:35:39 +01:00
deepikabhavnani c272377a81 Make sure no memory overhead if statistics are disabled 2018-11-26 09:42:45 -06:00
deepikabhavnani 068f2d14c0 Resolve IAR build issue
IAR not able to assign default zero value in array and complaints of
internal error as below:

[ERROR] Internal error: [Front end]: assertion failed at:
"..\..\Translator\compiler_core\src\parser\edg\decl_inits.c", line 2031
2018-11-26 09:42:45 -06:00
deepikabhavnani 117eb0bc87 Add socketstats stub functions for unittest and addressed reviews 2018-11-26 09:42:50 -06:00
Deepika f6c1a40b29 Add config options for socket statistics
1. MBED_CONF_NSAPI_SOCKET_STATS_ENABLE to enable the statistics
2. MBED_CONF_NSAPI_SOCKET_STATS_MAX_COUNT max sockets statistics cached
2018-11-26 09:42:45 -06:00
Deepika a851df66e3 Code/bug after testing
1. Fixing astyle and docs
2. Extra mutex lock was removed
3. Bytes are updated when send/recv > 0 and not in case of -ve error
4. Review comments
5. Guard statistics implementation in test with MBED_NW_STATS_ENABLED
2018-11-26 09:42:45 -06:00
Deepika eec54a0fc9 Update tcp test cases to verify network socket statistics
Cases Updated are:
1. TCPSOCKET_ECHOTEST_NONBLOCK
2. TCPSOCKET_OPEN_CLOSE_REPEAT
3. TCPSOCKET_OPEN_LIMIT
2018-11-26 09:42:45 -06:00
Deepika e7ea2927fc Update udp test cases to verify network socket statistics
Cases Updated are:
1. UDPSOCKET_ECHOTEST_NONBLOCK
2. UDPSOCKET_OPEN_CLOSE_REPEAT
3. UDPSOCKET_OPEN_LIMIT
2018-11-26 09:42:45 -06:00
Martin Kojtal c873dc06f2 Merge branch 'ONME-3983' of https://github.com/mtomczykmobica/mbed-os into dev_rollup 2018-11-24 21:14:47 +00:00
Michal Paszta e53ee631f9 Greentea netsocket and network tests improvements
Added smarter rounding of times in recv_timeout and increased the delta by one, to allow "off-by-one" errors.
Reverted commit 88eea6a, reducing TESTS_TIMEOUT back to 480.
Introduced a 100ms timeout for waiting on asynchronous DNS resolution.
Improved error handling on disconnects.
2018-11-19 08:58:14 +01:00
Marcin Tomczyk d3812f3740 ONME-3983 Fix the defects found in IPV4 testing against packet dropping 2018-11-15 13:47:43 +01:00
Marcin Tomczyk 5eabfabc51 ONME-3733 detect xinetd service pattern and generate correct pattern 2018-11-07 13:18:04 +01:00
Seppo Takalo 66a2101006 Continue Socket and WiFi tests even on test failure.
Purpose is to run full set of testcases on each run.
Testcases should contain proper cleanup handlers so that they are
independent.
2018-10-23 13:58:21 +03:00
Kevin Bracey 1ef213ec89 Clean up Thread deprecation warnings
Static Thread methods and signal methods have been deprecated. Remove
all references in the main code, and most of the tests. Some tests of
the deprecated APIs themselves remain.
2018-10-12 14:57:13 +03:00
Cruz Monrreal 506dfca8d0
Merge pull request #8235 from VeijoPesonen/mbedgt-netsocket-tc-fixes
Mbedgt netsocket tc fixes
2018-10-08 10:14:52 -05:00
Cruz Monrreal b1b6399482
Merge pull request #8132 from VeijoPesonen/bugfix-tests-netsocket-tcp-stacksize
gt netsocket tcp -  increases threads' stack size
2018-09-27 17:53:54 -05:00
Veijo Pesonen c4546910d1 Increases stack size for threads used in gt netsocket tcp test cases
Stack size is insufficient for debug profile
Stack size is insufficient for NUCLEO_F401RE+IDW01M1
Please see https://github.com/ARMmbed/wifi-x-nucleo-idw01m1/issues/17
2018-09-27 09:13:11 +03:00
Veijo Pesonen d302a62e60 Drops removed mbedgt-netsocket cases from test specification 2018-09-25 11:52:50 +03:00
Veijo Pesonen b355c750a6 Makes mbedgt-netsocket cases to accept port 0 as destination 2018-09-25 09:29:53 +03:00
Martin Kojtal cbb676ccbd
Merge pull request #8060 from SeppoTakalo/documentation_update
Clarify test configuration in Socket/Networking test document
2018-09-21 09:40:59 +02:00
Seppo Takalo 558b579a8d Remove the unstable SYNCHRONOUS_DNS_CACHE testcase
Will be reverted once the test case is fixed
2018-09-20 10:59:20 +01:00
Cruz Monrreal 836eec00ae
Merge pull request #7945 from jarlamsa/synchronous_dns_cache
Move SYNCHRONOUS_DNS_CACHE test to extended set
2018-09-14 13:12:04 -05:00
Veijo Pesonen 88eea6a390 Testing with ESP8266's AT firmware v1.7 takes more time 2018-09-14 12:07:19 +03:00
Veijo Pesonen 24905f5b50 Declares gt netsocket test case buffers as static
Original patch https://github.com/ARMmbed/wifi-x-nucleo-idw01m1/issues/17
2018-09-14 12:03:36 +03:00
Seppo Takalo 5e9fb0d562 Clarify test configuration in Socket/Networking test document 2018-09-10 18:08:31 +03:00
Cruz Monrreal 920db63453
Merge pull request #7803 from SeppoTakalo/socket-test-plan
Add Socket test plan
2018-09-09 22:44:00 -05:00
Jarno Lamsa bc2166e62d Temporarily move SYNCHRONOUS_DNS_CACHE test to extended set until issues fixed with it 2018-08-31 16:12:51 +03:00
Cruz Monrreal 7d871bfff5
Merge pull request #7879 from jarlamsa/synchronous_dns_tests
Add tests for synchronous dns
2018-08-29 09:38:41 -05:00
Amanda Butler 940c4b891d
Copy edit requested section of README.md
Copy edit for active voice, inclusion of articles and U.S. spelling.
2018-08-27 10:18:36 -05:00
Jarno Lamsa 0c758b9ee1 Add tests for synchronous dns 2018-08-27 15:05:41 +03:00
Mika Leppänen 3c03feff08 Updated greentea UDP tests to use default interface 2018-08-21 10:55:49 +03:00
Mika Leppänen 3f47963aff Updated greentea TCP tests to use default interface 2018-08-21 10:55:49 +03:00
Mika Leppänen aa80d6d14b Updated greentea DNS tests to use default interface 2018-08-21 10:55:49 +03:00
Seppo Takalo 0bb791ed0d Add Socket test plan
I'm submitting a test plan for Mbed OS sockets, so that we have
reference that describes wanted behaviour, required test environment,
and priorities of test cases.

This servers as a both documentation and specification. It needs to live
with source code, as opposed to Handbook, because it will be extend, modified
and fixed for faster cycle than what should be done for Handbook.

Part of this document (How to run -section) will be submitted to Handbook
with links to this.
2018-08-16 13:13:47 +03:00
Mika Leppänen 199244cf9c Moved ASYNCHRONOUS_DNS_SIMULTANEOUS_REPEAT under mbed extended tests
Test is giving problems in some networks. Could be that DNS server
is regarding repeated DNS enquiries on the test to be caused by
malfunctioning device.
2018-08-14 10:21:48 +03:00