Commit Graph

142 Commits (mbed-os-5.13)

Author SHA1 Message Date
Veijo Pesonen b0fca1ffc8 Test UDPSOCKET_SENDTO_INVALID allows NSAPI_ERROR_UNSUPPORTED 2019-01-29 10:59:06 +02:00
Michal Paszta af65522652 Publish TLSSocket test documentation
The whole README.md had to be updated to match the internal Confluence documentation, which can now be locked. In the process I also updated any spotted mistakes in tests documentation, removed the obsolete TCPServer tests documentation and added a test which was missing from UDPSocket's main.
2019-01-23 16:54:19 +02:00
Michal Paszta d568e2160b Add TLSSocket greentea tests.
TLSSocket tests based on existing TCPSocket greentea tests and TLSSocket icetea tests.
2019-01-22 12:46:48 +01:00
Martin Kojtal 7b29593a41
Merge pull request #9415 from SeppoTakalo/ONME-4140
Allow NSAPI_ERROR_UNSUPPORTED from Socket::setsockopt()
2019-01-21 13:43:37 +01:00
Martin Kojtal 5c46faeb86
Merge pull request #9417 from jeromecoutant/PR_DNSTIMEOUT
Netsocket DNS test: increase timeout value
2019-01-21 13:42:24 +01:00
Seppo Takalo 6b92d32b3e Fix TCPSOCKET_ENDPOINT_CLOSE: Cannot accept WOULD_BLOCK
This testcase uses Socket in blocking mode, and therefore
WOULD_BLOCK should not be accepted.
The logic was wrong anyway, because return value was tested
to be negative before testing with WOULD_BLOCK which is negative
as well.

Also replaced TEST_FAIL() macro with TEST_ASSERT_EQUAL() to
make the return code visible in test log.
2019-01-21 10:46:11 +02:00
Cruz Monrreal 68deb05d1b
Merge pull request #9376 from michalpasztamobica/tcpsocket_greentea
TCP/UDP greentea tests refactoring and cleanup
2019-01-17 21:52:40 -06:00
jeromecoutant 3a190656fa Netsocket DNS test: increase timeout value 2019-01-17 17:39:43 +01:00
Seppo Takalo 26dcd0d90a Allow NSAPI_ERROR_UNSUPPORTED from Socket::setsockopt() 2019-01-17 18:02:04 +02:00
Michal Paszta 6e629e1ba6 Gemalto Crinterion UDP test adjustments
Adjusting the tests to match the cellular modems ELS61-E2 and BGS2-W requirements.
2019-01-15 12:38:48 +01:00
Michal Paszta 59e8dedb67 TCP/UDP greentea tests refactoring and cleanup 2019-01-15 10:00:35 +01:00
Martin Kojtal cc89c20abc
Merge pull request #9175 from michalpasztamobica/greentea_ignore_unsupported
Greentea tests ignore bind returning UNSUPPORTED
2019-01-03 14:59:50 +00:00
Michal Paszta a2110d5411 Greentea tests ignore bind returning UNSUPPORTED 2018-12-20 15:38:07 +01:00
Seppo Takalo 18404e93be Drop MBED_EXTENTED_TESTS flagging from network tests.
All properly working IP stacks are required to pass Mbed OS socket tests.
This have now proven with current Ethernet devices with LwIP stack.
2018-12-19 16:18:33 +02:00
jeromecoutant bd4b99c498 DNS tests: improve debug messages 2018-12-18 13:32:45 +01:00
Kari Haapalehto e502675bd1 Fix test-netsocket-tcp greentea test build fails.
main.cpp was missing comma at the end of line.
2018-12-11 12:51:30 +02:00
Michal Paszta c48312ded4 Missing socket greentea tests implementation 2018-12-07 10:35:39 +01:00
deepikabhavnani c272377a81 Make sure no memory overhead if statistics are disabled 2018-11-26 09:42:45 -06:00
deepikabhavnani 068f2d14c0 Resolve IAR build issue
IAR not able to assign default zero value in array and complaints of
internal error as below:

[ERROR] Internal error: [Front end]: assertion failed at:
"..\..\Translator\compiler_core\src\parser\edg\decl_inits.c", line 2031
2018-11-26 09:42:45 -06:00
deepikabhavnani 117eb0bc87 Add socketstats stub functions for unittest and addressed reviews 2018-11-26 09:42:50 -06:00
Deepika f6c1a40b29 Add config options for socket statistics
1. MBED_CONF_NSAPI_SOCKET_STATS_ENABLE to enable the statistics
2. MBED_CONF_NSAPI_SOCKET_STATS_MAX_COUNT max sockets statistics cached
2018-11-26 09:42:45 -06:00
Deepika a851df66e3 Code/bug after testing
1. Fixing astyle and docs
2. Extra mutex lock was removed
3. Bytes are updated when send/recv > 0 and not in case of -ve error
4. Review comments
5. Guard statistics implementation in test with MBED_NW_STATS_ENABLED
2018-11-26 09:42:45 -06:00
Deepika eec54a0fc9 Update tcp test cases to verify network socket statistics
Cases Updated are:
1. TCPSOCKET_ECHOTEST_NONBLOCK
2. TCPSOCKET_OPEN_CLOSE_REPEAT
3. TCPSOCKET_OPEN_LIMIT
2018-11-26 09:42:45 -06:00
Deepika e7ea2927fc Update udp test cases to verify network socket statistics
Cases Updated are:
1. UDPSOCKET_ECHOTEST_NONBLOCK
2. UDPSOCKET_OPEN_CLOSE_REPEAT
3. UDPSOCKET_OPEN_LIMIT
2018-11-26 09:42:45 -06:00
Martin Kojtal c873dc06f2 Merge branch 'ONME-3983' of https://github.com/mtomczykmobica/mbed-os into dev_rollup 2018-11-24 21:14:47 +00:00
Michal Paszta e53ee631f9 Greentea netsocket and network tests improvements
Added smarter rounding of times in recv_timeout and increased the delta by one, to allow "off-by-one" errors.
Reverted commit 88eea6a, reducing TESTS_TIMEOUT back to 480.
Introduced a 100ms timeout for waiting on asynchronous DNS resolution.
Improved error handling on disconnects.
2018-11-19 08:58:14 +01:00
Marcin Tomczyk d3812f3740 ONME-3983 Fix the defects found in IPV4 testing against packet dropping 2018-11-15 13:47:43 +01:00
Marcin Tomczyk 5eabfabc51 ONME-3733 detect xinetd service pattern and generate correct pattern 2018-11-07 13:18:04 +01:00
Seppo Takalo 66a2101006 Continue Socket and WiFi tests even on test failure.
Purpose is to run full set of testcases on each run.
Testcases should contain proper cleanup handlers so that they are
independent.
2018-10-23 13:58:21 +03:00
Kevin Bracey 1ef213ec89 Clean up Thread deprecation warnings
Static Thread methods and signal methods have been deprecated. Remove
all references in the main code, and most of the tests. Some tests of
the deprecated APIs themselves remain.
2018-10-12 14:57:13 +03:00
Cruz Monrreal 506dfca8d0
Merge pull request #8235 from VeijoPesonen/mbedgt-netsocket-tc-fixes
Mbedgt netsocket tc fixes
2018-10-08 10:14:52 -05:00
Cruz Monrreal b1b6399482
Merge pull request #8132 from VeijoPesonen/bugfix-tests-netsocket-tcp-stacksize
gt netsocket tcp -  increases threads' stack size
2018-09-27 17:53:54 -05:00
Veijo Pesonen c4546910d1 Increases stack size for threads used in gt netsocket tcp test cases
Stack size is insufficient for debug profile
Stack size is insufficient for NUCLEO_F401RE+IDW01M1
Please see https://github.com/ARMmbed/wifi-x-nucleo-idw01m1/issues/17
2018-09-27 09:13:11 +03:00
Veijo Pesonen d302a62e60 Drops removed mbedgt-netsocket cases from test specification 2018-09-25 11:52:50 +03:00
Veijo Pesonen b355c750a6 Makes mbedgt-netsocket cases to accept port 0 as destination 2018-09-25 09:29:53 +03:00
Martin Kojtal cbb676ccbd
Merge pull request #8060 from SeppoTakalo/documentation_update
Clarify test configuration in Socket/Networking test document
2018-09-21 09:40:59 +02:00
Seppo Takalo 558b579a8d Remove the unstable SYNCHRONOUS_DNS_CACHE testcase
Will be reverted once the test case is fixed
2018-09-20 10:59:20 +01:00
Cruz Monrreal 836eec00ae
Merge pull request #7945 from jarlamsa/synchronous_dns_cache
Move SYNCHRONOUS_DNS_CACHE test to extended set
2018-09-14 13:12:04 -05:00
Veijo Pesonen 88eea6a390 Testing with ESP8266's AT firmware v1.7 takes more time 2018-09-14 12:07:19 +03:00
Veijo Pesonen 24905f5b50 Declares gt netsocket test case buffers as static
Original patch https://github.com/ARMmbed/wifi-x-nucleo-idw01m1/issues/17
2018-09-14 12:03:36 +03:00
Seppo Takalo 5e9fb0d562 Clarify test configuration in Socket/Networking test document 2018-09-10 18:08:31 +03:00
Cruz Monrreal 920db63453
Merge pull request #7803 from SeppoTakalo/socket-test-plan
Add Socket test plan
2018-09-09 22:44:00 -05:00
Jarno Lamsa bc2166e62d Temporarily move SYNCHRONOUS_DNS_CACHE test to extended set until issues fixed with it 2018-08-31 16:12:51 +03:00
Cruz Monrreal 7d871bfff5
Merge pull request #7879 from jarlamsa/synchronous_dns_tests
Add tests for synchronous dns
2018-08-29 09:38:41 -05:00
Amanda Butler 940c4b891d
Copy edit requested section of README.md
Copy edit for active voice, inclusion of articles and U.S. spelling.
2018-08-27 10:18:36 -05:00
Jarno Lamsa 0c758b9ee1 Add tests for synchronous dns 2018-08-27 15:05:41 +03:00
Mika Leppänen 3c03feff08 Updated greentea UDP tests to use default interface 2018-08-21 10:55:49 +03:00
Mika Leppänen 3f47963aff Updated greentea TCP tests to use default interface 2018-08-21 10:55:49 +03:00
Mika Leppänen aa80d6d14b Updated greentea DNS tests to use default interface 2018-08-21 10:55:49 +03:00
Seppo Takalo 0bb791ed0d Add Socket test plan
I'm submitting a test plan for Mbed OS sockets, so that we have
reference that describes wanted behaviour, required test environment,
and priorities of test cases.

This servers as a both documentation and specification. It needs to live
with source code, as opposed to Handbook, because it will be extend, modified
and fixed for faster cycle than what should be done for Handbook.

Part of this document (How to run -section) will be submitted to Handbook
with links to this.
2018-08-16 13:13:47 +03:00
Mika Leppänen 199244cf9c Moved ASYNCHRONOUS_DNS_SIMULTANEOUS_REPEAT under mbed extended tests
Test is giving problems in some networks. Could be that DNS server
is regarding repeated DNS enquiries on the test to be caused by
malfunctioning device.
2018-08-14 10:21:48 +03:00
Martin Kojtal e52bb68f93 tests: astyle fix
All tests should comply to our coding standard now
2018-08-03 10:23:38 +01:00
Veijo Pesonen dd6ec037d7 Makes Greentea TCP test cases to timeout less in connection errors
Made to prevent timeout if a single test case fails. The goal is that
each test case might wait only half of the remaining time reserved for
running TCP test cases.
2018-07-26 09:39:04 +03:00
Juha Ylinen 3c32b3ada7 Update Greentea netsocket and wifi tests
Increase timeout for netsocket TCP and UDP tests. Old timeout
(240 seconds) was not enough for slower devices to complete the
tests.
Accept error codes NSAPI_ERROR_CONNECTION_TIMEOUT and
NSAPI_ERROR_NO_CONNECTION when running test wifi_connect_secure_fail
2018-06-21 09:01:15 +03:00
Mika Leppänen ef14f549e4 Asynchronous DNS greentea tests
Added tests for asynchronous DNS.
2018-06-19 11:18:22 +03:00
Jarno Lamsa 6bdefd3041 Tolerate packet loss up to 30% in udp echo tests 2018-06-14 10:16:26 +03:00
Mika Leppänen 35f064fc69 Changed TCP socket test to use shared buffers
Changed RX and TX buffers used in TCP socket tests to global variables
to conserve memory.
2018-06-04 13:51:32 +03:00
Veijo Pesonen 3e6bc32df6 Makes UDPSOCKET_SENDTO_INVALID part of the netsocket extended test set 2018-05-30 12:17:53 +03:00
Veijo Pesonen 491a7ea03e Fixes findings from Greentea netsocket TCP test cases 2018-05-25 09:39:36 +03:00
Veijo Pesonen 3e11a3e666 Fixes findings from Greentea netsocket UDP test cases 2018-05-25 09:39:36 +03:00
Veijo Pesonen 21ec972798 Switches Greentea netsocket test case naming convention
From lowercase to uppercase and drops 'test_'-prefix. Test case
descriptions do also match to TC names now.

Additionally all the TCs are not behing MBED_EXTENDED_TESTS
anymore.
2018-05-25 09:39:36 +03:00
Veijo Pesonen 1b041721a0 Fixes Greentea UDP test cases
udpsocket_echotest.cpp
	udpsocket_echotest_burst.cpp
2018-05-25 09:39:36 +03:00
Veijo Pesonen 4fa57e36fe Greentea TCP test cases - check all socket calls 2018-05-25 09:39:36 +03:00
Veijo Pesonen 1fef1602a2 Adds UDP Greentea test cases
udpsocket_echotest
	udpsocket_echotest_nonblock
2018-05-25 09:39:36 +03:00
Veijo Pesonen a2f5ffa752 Adds UDP Greentea test case
udpsocket_sendto_repeat
2018-05-25 09:39:35 +03:00
Veijo Pesonen 19335741df Adds TCP test case
tcpsocket_send_repeat
2018-05-25 09:39:35 +03:00
Veijo Pesonen 096ed1e451 Adds UDP Greentea test case
udpsocket_sendto_invalid
2018-05-25 09:39:35 +03:00
Veijo Pesonen 420459b8de Removes obsolete TCP and UDP Greentea test cases 2018-05-25 09:39:35 +03:00
Veijo Pesonen aee6b06e0c Adds TCP test case
tcpsocket_echotest
	tcpsocket_echotest_nonblock
2018-05-25 09:38:23 +03:00
Veijo Pesonen df825cb3f9 Adds TCP test case
tcpsocket_connect_invalid
2018-05-25 09:38:23 +03:00
Veijo Pesonen 38b8865bcc Adds TCP and UDP test cases
tcpsocket_open_close_repeat
	udpsocket_open_close_repeat
2018-05-25 09:35:14 +03:00
Veijo Pesonen c86bf1acd0 Adds more TCP and UDP test cases
Adds TCP and UDP test cases

        tcpsocket_open_limit
        udpsocket_open_limit
2018-05-25 09:35:14 +03:00
Veijo Pesonen f04f7c1773 Starts adding more TCP and UDP performance tests
Starts splitting Greentea test suites to TCP and UDP suites and adds
more test cases like

	tcpsocket_echotest_burst
	tcpsocket_echotest_burst_nonblock
	tcpsocket_endpoint_close
	tcpsocket_recv_100k
	tcpsocket_recv_100k
	tcpsocket_recv_timeout
	tcpsocket_send_timeout
	tcpsocket_thread_per_socket_safety
	udpsocket_echotest_burst
	udpsocket_echotest_burst_nonblock
	udpsocket_recv_timeout
	udpsocket_sendto_timeout
2018-05-25 09:35:14 +03:00
Veijo Pesonen 2f410b0ce2 Rely on ARM's and U-Blox's echo servers
Make the server as default. Use the hostnames instead of plain IP addresses.
2018-05-25 09:35:14 +03:00
Kevin Bracey f584ac3b59 Connectivity test: don't create interface object twice 2018-05-23 12:24:00 +03:00
Brendan McDonnell c4f10aafee typos 2018-02-20 20:11:19 -05:00
jeromecoutant d25d457652 NETSOCKET pressure tests configuration 2018-02-14 15:18:07 +01:00
Wolfgang Betz d6cb3853df Enlarge event queue in `test_socket_attach()` 2018-02-07 13:40:50 +01:00
Wolfgang Betz 8ec9f6b430 Correct test `socket_sigio`
A call to

    `TCPSocket::recv(void *data, nsapi_size_t size)`

returns, following the mbed documentation, the number of received bytes on
success, and a negative error code on failure.

So in case of success, the return value depends on both the value of parameter
`size` but also on the amount of data already available. This means, that the
value returned can be lower than or equal to the `size` of the `data` buffer
passed as argument to the call.

Therefore, in the cases of `test_tcp_hello_world()` & `find_substring()`
(i.e. test `socket_sigio`), the calls to `TCPSocket::recv()` might return from
one byte up to `sizeof(buffer) - 1` (i.e. 511) bytes for each single call,
while the tests expect to receive the whole response string with a single call.

This commit applies a fix to this situation by implementing a receive loop
which exits once there is no data anymore available to be read from the socket.
2018-02-02 10:29:46 +01:00
Senthil Ramakrishnan d82566cc6b Fix tcp_hello_world test to receive all the data from http response 2018-01-08 14:18:06 -06:00
Senthil Ramakrishnan 47390e62d6 ESP8266 test config and tcp_echo test fix for ESP8266 2018-01-08 14:18:06 -06:00
jeromecoutant d8cc5a3850 tests-netsocket-socket_sigio
HTTP_SERVER_NAME and HTTP_SERVER_FILE_PATH are replaced by
  MBED_CONF_APP_HTTP_SERVER_NAME and MBED_CONF_APP_HTTP_SERVER_FILE_PATH
  to allow user to make local tests

Test on HTTP connect added as test was always OK even with no connection...
2017-12-04 17:55:11 +01:00
jeromecoutant bff8fc1534 tests-netsocket-tcp_hello_world
HTTP_SERVER_NAME and HTTP_SERVER_FILE_PATH are replaced by
  MBED_CONF_APP_HTTP_SERVER_NAME and MBED_CONF_APP_HTTP_SERVER_FILE_PATH
  to allow user to make local tests
2017-12-04 17:55:10 +01:00
jeromecoutant df27bca67d tests-netsocket-tcp_echo
UUID lines are removed as they were not used

default case:
If MBED_CONF_APP_ECHO_SERVER_ADDR and MBED_CONF_APP_ECHO_SERVER_PORT are not defined
test is using Greentea to get server information (code before OS 5.6.1 version)

TCP_ECHO_PREFIX is no more a mandatory step
2017-12-04 17:55:09 +01:00
jeromecoutant 3cb8316993 tests-netsocket-udp_echo
UUID lines are removed as they were not used

default case:
If MBED_CONF_APP_ECHO_SERVER_ADDR and MBED_CONF_APP_ECHO_SERVER_PORT are not defined
test is using Greentea to get server information (code before OS 5.6.1 version)
2017-12-04 17:55:08 +01:00
jeromecoutant 61b8468db9 tests-netsocket-gethostbyname
MBED_DNS_TEST_HOST define is replaced by MBED_CONF_APP_DNS_TEST_HOST to allow user to change host name for local tests
2017-12-04 17:55:07 +01:00
Sarah Marsh 8c5c905d95 Limit size of equeue for sigio net test 2017-11-09 17:56:53 -06:00
Sarah Marsh fbe8dfae19 update domain name to os.mbed.com 2017-09-22 09:40:32 -05:00
Sarah Marsh 6a44ceb094 Add copyright headers and use mbed error to skip tests without network config files 2017-09-20 18:31:06 -05:00
Sarah Marsh 8f9242fe40 Add netsocket tests 2017-09-20 18:27:58 -05:00
Christopher Haster 4cad764162 Added copyright header to all tests 2017-08-07 12:02:33 -05:00
Christopher Haster 281a0e2fe1 nsapi - Added rudimentary ip parsing tests 2016-10-19 15:28:32 -05:00