mirror of https://github.com/ARMmbed/mbed-os.git
Further changes to reflect workspace_tools to tools rename
Mihail Stoyanov
parent
3d45b2cdbb
commit
42c62abed1
|
|
@ -1,7 +1,7 @@
|
|||
python:
|
||||
- "2.7"
|
||||
|
||||
script: "python workspace_tools/build_travis.py"
|
||||
script: "python tools/build_travis.py"
|
||||
before_install:
|
||||
- sudo add-apt-repository -y ppa:terry.guo/gcc-arm-embedded
|
||||
- sudo apt-get update -qq
|
||||
|
|
|
|||
|
|
@ -1,3 +1,3 @@
|
|||
graft workspace_tools
|
||||
recursive-exclude workspace_tools *.pyc
|
||||
graft tools
|
||||
recursive-exclude tools *.pyc
|
||||
include LICENSE
|
||||
|
|
|
|||
|
|
@ -157,7 +157,7 @@ Develop
|
|||
```
|
||||
> "venv/Scripts/activate"
|
||||
> pip install -r requirements.txt
|
||||
> cd workspace_tools
|
||||
> cd tools
|
||||
> ... do things ...
|
||||
> "venv/Scripts/deactivate"
|
||||
```
|
||||
|
|
|
|||
|
|
@ -130,11 +130,11 @@ Checking out files: 100% (3994/3994), done.
|
|||
```
|
||||
$ cd mbed
|
||||
$ ls
|
||||
LICENSE MANIFEST.in README.md libraries setup.py travis workspace_tools
|
||||
LICENSE MANIFEST.in README.md libraries setup.py travis tools
|
||||
```
|
||||
Directory structure we are interested in:
|
||||
```
|
||||
mbed/workspace_tools/ - test suite scripts, build scripts etc.
|
||||
mbed/tools/ - test suite scripts, build scripts etc.
|
||||
mbed/libraries/tests/ - mbed SDK tests,
|
||||
mbed/libraries/tests/mbed/ - tests for mbed SDK and peripherals tests,
|
||||
mbed/libraries/tests/net/echo/ - tests for Ethernet interface,
|
||||
|
|
@ -153,7 +153,7 @@ Workspace tools are set of Python scripts used off-line by Mbed SDK team to:
|
|||
Before we can run our first test we need to configure our test environment a little!
|
||||
Now we need to tell workspace tools where our compilers are.
|
||||
|
||||
* Please to go ```mbed/workspace_tools/``` directory and create empty file called ```private_settings.py```.
|
||||
* Please to go ```mbed/tools/``` directory and create empty file called ```private_settings.py```.
|
||||
```
|
||||
$ touch private_settings.py
|
||||
```
|
||||
|
|
@ -203,13 +203,13 @@ GCC_CR_PATH = "C:/Work/toolchains/LPCXpresso_6.1.4_194/lpcxpresso/tools/bin"
|
|||
IAR_PATH = "C:/Work/toolchains/iar_6_5/arm"
|
||||
```
|
||||
|
||||
Note: Settings in ```private_settings.py``` will overwrite variables with default values in ```mbed/workspace_tools/settings.py``` file.
|
||||
Note: Settings in ```private_settings.py``` will overwrite variables with default values in ```mbed/tools/settings.py``` file.
|
||||
|
||||
## Build Mbed SDK library from sources
|
||||
Let's build mbed SDK library off-line from sources using your compiler. We've already cloned mbed SDK sources, we've also installed compilers and added their paths to ```private_settings.py```.
|
||||
We now should be ready to use workspace tools script ```build.py``` to compile and build mbed SDK from sources.
|
||||
|
||||
We are still using console. You should be already in ```mbed/workspace_tools/``` directory if not go to ```mbed/workspace_tools/``` and type below command:
|
||||
We are still using console. You should be already in ```mbed/tools/``` directory if not go to ```mbed/tools/``` and type below command:
|
||||
```
|
||||
$ python build.py -m LPC1768 -t ARM
|
||||
```
|
||||
|
|
@ -276,7 +276,7 @@ Build successes:
|
|||
|
||||
### build.py script
|
||||
|
||||
Build script located in mbed/workspace_tools/ is our core script solution to drive compilation, linking and building process for:
|
||||
Build script located in mbed/tools/ is our core script solution to drive compilation, linking and building process for:
|
||||
|
||||
* mbed SDK (with libs like Ethernet, RTOS, USB, USB host).
|
||||
* Tests which also can be linked with libraries like RTOS or Ethernet.
|
||||
|
|
@ -426,7 +426,7 @@ $ python build.py -t uARM -m NUCLEO_F334R8 --cppcheck
|
|||
```
|
||||
|
||||
# make.py script
|
||||
```make.py``` is a ```mbed/workspace_tools/``` script used to build tests (we call them sometimes 'programs') one by one manually. This script allows you to flash board, execute and test it. However, this script is deprecated and will not be described here. Instead please use ```singletest.py``` file to build mbed SDK, tests and run automation for test cases included in ```mbedmicro/mbed```.
|
||||
```make.py``` is a ```mbed/tools/``` script used to build tests (we call them sometimes 'programs') one by one manually. This script allows you to flash board, execute and test it. However, this script is deprecated and will not be described here. Instead please use ```singletest.py``` file to build mbed SDK, tests and run automation for test cases included in ```mbedmicro/mbed```.
|
||||
Note: ```make.py``` script depends on existing already built mbed SDK and library sources so you need to pre-build mbed SDK and other libraries (such as RTOS library) to link 'program' (test) with mbed SDK and RTOS library. To pre-build mbed SDK please use ```build.py``` script.
|
||||
|
||||
Just for sake of example please see few ways to use ```make.py``` together with Freedom K64F board.
|
||||
|
|
|
|||
|
|
@ -198,7 +198,7 @@ $ astyle.exe --style=kr --indent=spaces=4 --indent-switches $(FULL_CURRENT_PATH)
|
|||
```
|
||||
|
||||
## Python coding rules & coding guidelines
|
||||
Some of our tools in workspace_tools are written in ```Python 2.7```. In case of developing tools for python we prefer to keep similar code styles across all Python source code. Please note that not all rules must be enforced. For example we do not limit you to 80 characters per line, just be sure your code can fit to widescreen display.
|
||||
Some of our tools in tools are written in ```Python 2.7```. In case of developing tools for python we prefer to keep similar code styles across all Python source code. Please note that not all rules must be enforced. For example we do not limit you to 80 characters per line, just be sure your code can fit to widescreen display.
|
||||
|
||||
Please stay compatible with ```Python 2.7``` but nothing stops you to write your code so in the future it will by Python 3 friendly.
|
||||
|
||||
|
|
@ -211,7 +211,7 @@ Some general guidelines:
|
|||
* Please document your code, write comments and ```doc``` sections for each function or class you implement.
|
||||
|
||||
### Static Code Analizers for Python
|
||||
If you are old-school developer for sure you remember tools like lint. "lint was the name originally given to a particular program that flagged some suspicious and non-portable constructs (likely to be bugs) in C language source code." Now lint-like programs are used to check similar code issues for multiple languages, also for Python. Please do use them if you want to commit new code to workspace_tools and other mbed SDK Python tooling.
|
||||
If you are old-school developer for sure you remember tools like lint. "lint was the name originally given to a particular program that flagged some suspicious and non-portable constructs (likely to be bugs) in C language source code." Now lint-like programs are used to check similar code issues for multiple languages, also for Python. Please do use them if you want to commit new code to tools and other mbed SDK Python tooling.
|
||||
|
||||
Below is the list Python lint tools you may want to use:
|
||||
|
||||
|
|
@ -254,7 +254,7 @@ class HostRegistry:
|
|||
```
|
||||
|
||||
## Testing
|
||||
Please refer to TESTING.md document for detais regarding mbed SDK test suite and build scripts included in ```mbed/workspace_tools/```.
|
||||
Please refer to TESTING.md document for detais regarding mbed SDK test suite and build scripts included in ```mbed/tools/```.
|
||||
|
||||
## Before pull request checklist
|
||||
* Your pull request description section contains:
|
||||
|
|
|
|||
|
|
@ -6,7 +6,7 @@ Test suit allows users to run locally on their machines Mbed SDK’s tests inclu
|
|||
Each test is supervised by python script called “host test” which will at least Test suite is using build script API to compile and build test source together with required by test libraries like CMSIS, Mbed, Ethernet, USB etc.
|
||||
|
||||
## What is host test?
|
||||
Test suite supports test supervisor concept. This concept is realized by separate Python script called ```host test```. Host tests can be found in ```mbed/workspace_tools/host_tests/``` directory. Note: In newer mbed versions (mbed OS) host tests will be separate library.
|
||||
Test suite supports test supervisor concept. This concept is realized by separate Python script called ```host test```. Host tests can be found in ```mbed/tools/host_tests/``` directory. Note: In newer mbed versions (mbed OS) host tests will be separate library.
|
||||
|
||||
Host test script is executed in parallel with test runner to monitor test execution. Basic host test just monitors device's default serial port for test results returned by test runner. Simple tests will print test result on serial port. In other cases host tests can for example judge by test results returned by test runner if test passed or failed. It all depends on test itself.
|
||||
|
||||
|
|
@ -14,7 +14,7 @@ In some cases host test can be TCP server echoing packets from test runner and j
|
|||
|
||||
## Test suite core: singletest.py script
|
||||
|
||||
```singletest.py``` script located in ```mbed/workspace_tools/``` is a test suite script which allows users to compile, build tests and test runners (also supports CppUTest unit test library). Script also is responsible for test execution on devices selected by configuration files.
|
||||
```singletest.py``` script located in ```mbed/tools/``` is a test suite script which allows users to compile, build tests and test runners (also supports CppUTest unit test library). Script also is responsible for test execution on devices selected by configuration files.
|
||||
|
||||
### Parameters of singletest.py
|
||||
|
||||
|
|
@ -37,7 +37,7 @@ After connecting boards to our host machine (PC) we can check which serial ports
|
|||
* ```NUCLEO_F103RB``` serial port is on ```COM11``` and disk drive is ```I:```.
|
||||
If you are working under Linux your port and disk could look like /dev/ttyACM5 and /media/usb5.
|
||||
|
||||
This information is needed to create ```muts_all.json``` configuration file. You can create it in ```mbed/workspace_tools/``` directory:
|
||||
This information is needed to create ```muts_all.json``` configuration file. You can create it in ```mbed/tools/``` directory:
|
||||
```
|
||||
$ touch muts_all.json
|
||||
```
|
||||
|
|
@ -67,8 +67,8 @@ Its name will be passed to ```singletest.py``` script after ```-M``` (MUTs speci
|
|||
|
||||
Note: We will leave field ```peripherals``` empty for the sake of this example. We will explain it later. All you need to do now is to properly fill fields ```mcu```, ```port``` and ```disk```.
|
||||
|
||||
Note: Please make sure files muts_all.json and test_spec.json are in workspace_tools/ directory. We will assume in this example they are.
|
||||
Where to find ```mcu``` names? You can use option ```-S``` of ```build.py``` script (in ```mbed/workspace_tools/``` directory) to check all supported off-line MCUs names.
|
||||
Note: Please make sure files muts_all.json and test_spec.json are in tools/ directory. We will assume in this example they are.
|
||||
Where to find ```mcu``` names? You can use option ```-S``` of ```build.py``` script (in ```mbed/tools/``` directory) to check all supported off-line MCUs names.
|
||||
|
||||
Note: If you update mbed device firmware or even disconnect / reconnect mbed device you may find that serial port / disk configuration changed. You need to update configuration file accordingly or you will face connection problems and obviously tests will not run.
|
||||
|
||||
|
|
@ -172,9 +172,9 @@ For our example purposes let's assume we only have Keil ARM compiler, so let's c
|
|||
```
|
||||
#### Run your tests
|
||||
|
||||
After you configure all your MUTs and compilers you are ready to run tests. Make sure your devices are connected and your configuration files reflect your current configuration (serial ports, devices). Go to workspace_tools directory in your mbed location.
|
||||
After you configure all your MUTs and compilers you are ready to run tests. Make sure your devices are connected and your configuration files reflect your current configuration (serial ports, devices). Go to tools directory in your mbed location.
|
||||
```
|
||||
$ cd workspace_tools/
|
||||
$ cd tools/
|
||||
```
|
||||
and execute test suite script.
|
||||
```
|
||||
|
|
@ -244,7 +244,7 @@ In below example we would like to have all test binaries called ```firmware.bin`
|
|||
```
|
||||
$ python singletest.py -i test_spec.json -M muts_all.json --firmware-name firmware
|
||||
```
|
||||
* Where to find test list? Tests are defined in file ```tests.py``` in ```mbed/workspace_tools/``` directory. ```singletest.py``` uses test metadata in ```tests.py``` to resolve libraries dependencies and build tests for proper platforms and peripherals. Option ```-R``` can be used to get test names and direct path and test configuration.
|
||||
* Where to find test list? Tests are defined in file ```tests.py``` in ```mbed/tools/``` directory. ```singletest.py``` uses test metadata in ```tests.py``` to resolve libraries dependencies and build tests for proper platforms and peripherals. Option ```-R``` can be used to get test names and direct path and test configuration.
|
||||
```
|
||||
$ python singletest.py -R
|
||||
+-------------+-----------+---------------------------------------+--------------+-------------------+----------+--------------------------------------------------------+
|
||||
|
|
@ -344,7 +344,7 @@ test_spec.json:
|
|||
```
|
||||
Note:
|
||||
* Please make sure device is connected before we will start running tests.
|
||||
* Please make sure files ```muts_all.json``` and ```test_spec.json``` are in ```mbed/workspace_tools/``` directory.
|
||||
* Please make sure files ```muts_all.json``` and ```test_spec.json``` are in ```mbed/tools/``` directory.
|
||||
Now you can call test suite and execute tests:
|
||||
```
|
||||
$ python singletest.py -i test_spec.json -M muts_all.json
|
||||
|
|
@ -451,7 +451,7 @@ We want to create directory structure similar to one below:
|
|||
└───mbed
|
||||
├───libraries
|
||||
├───travis
|
||||
└───workspace_tools
|
||||
└───tools
|
||||
```
|
||||
|
||||
Please go to directory with your project. For example it could be c:\Projects\Project.
|
||||
|
|
@ -492,7 +492,7 @@ $ git clone https://github.com/mbedmicro/mbed.git
|
|||
$ hg clone https://mbed.org/users/rgrover1/code/cpputest/
|
||||
```
|
||||
|
||||
After above three steps you should have proper directory structure. All you need to do now is to configure your ```private_settings.py``` in ```mbed/workspace_tools/``` directory. Please refer to mbed SDK build script documentation for details.
|
||||
After above three steps you should have proper directory structure. All you need to do now is to configure your ```private_settings.py``` in ```mbed/tools/``` directory. Please refer to mbed SDK build script documentation for details.
|
||||
|
||||
## CppUTest with mbed port
|
||||
To make sure you actualy have CppUTest library with mbed SDK port you can go to CppUTest ```armcc``` platform directory:
|
||||
|
|
@ -577,7 +577,7 @@ utest
|
|||
```
|
||||
|
||||
## Define unit tests in mbed SDK test suite structure
|
||||
All tests defined in test suite are described in ```mbed/workspace_tools/tests.py``` file. This file stores data structure ```TESTS``` which is a list of simple structures describing each test. Below you can find example of ```TESTS``` structure which is configuring one of the unit tests.
|
||||
All tests defined in test suite are described in ```mbed/tools/tests.py``` file. This file stores data structure ```TESTS``` which is a list of simple structures describing each test. Below you can find example of ```TESTS``` structure which is configuring one of the unit tests.
|
||||
```
|
||||
.
|
||||
.
|
||||
|
|
|
|||
|
|
@ -1,6 +1,6 @@
|
|||
# Adding and configuring mbed targets
|
||||
|
||||
mbed uses JSON as a description language for its build targets. The JSON description of mbed targets can be found in `workspace_tools/targets.json`. To better understand how a target is defined, we'll use this example (taken from `targets.json`):
|
||||
mbed uses JSON as a description language for its build targets. The JSON description of mbed targets can be found in `tools/targets.json`. To better understand how a target is defined, we'll use this example (taken from `targets.json`):
|
||||
|
||||
```
|
||||
"TEENSY3_1": {
|
||||
|
|
@ -173,4 +173,4 @@ This property is used to pass additional data to the project generator (used to
|
|||
```
|
||||
|
||||
The `target` property of `progen` specifies the target name that must be used for the exporter (if different than the mbed target name).
|
||||
For each exporter, a template for exporting can also be specified. In this example, the template used for generating a uVision project file is in a file called `uvision_microlib.uvproj.tmpl`. It is assumed that all the templates are located in `workspace_tools/export`.
|
||||
For each exporter, a template for exporting can also be specified. In this example, the template used for generating a uVision project file is in a file called `uvision_microlib.uvproj.tmpl`. It is assumed that all the templates are located in `tools/export`.
|
||||
|
|
|
|||
4
setup.py
4
setup.py
|
|
@ -16,9 +16,9 @@ DESCRIPTION = """A set of Python scripts that can be used to compile programs wr
|
|||
OWNER_NAMES = 'emilmont, bogdanm'
|
||||
OWNER_EMAILS = 'Emilio.Monti@arm.com, Bogdan.Marinescu@arm.com'
|
||||
|
||||
# If private_settings.py exists in workspace_tools, read it in a temporary file
|
||||
# If private_settings.py exists in tools, read it in a temporary file
|
||||
# so it can be restored later
|
||||
private_settings = join('workspace_tools', 'private_settings.py')
|
||||
private_settings = join('tools', 'private_settings.py')
|
||||
backup = None
|
||||
if isfile(private_settings):
|
||||
backup = TemporaryFile()
|
||||
|
|
|
|||
|
|
@ -139,7 +139,7 @@ def run_builds(dry_run):
|
|||
toolchain_list = build["toolchains"]
|
||||
if type(toolchain_list) != type([]): toolchain_list = [toolchain_list]
|
||||
for toolchain in toolchain_list:
|
||||
cmdline = "python workspace_tools/build.py -m %s -t %s -j 4 -c --silent "% (build["target"], toolchain)
|
||||
cmdline = "python tools/build.py -m %s -t %s -j 4 -c --silent "% (build["target"], toolchain)
|
||||
libs = build.get("libs", [])
|
||||
if libs:
|
||||
cmdline = cmdline + " ".join(["--" + l for l in libs])
|
||||
|
|
@ -163,14 +163,14 @@ def run_test_linking(dry_run):
|
|||
for test_lib in tests:
|
||||
test_names = tests[test_lib]
|
||||
test_lib_switch = "--" + test_lib if test_lib else ""
|
||||
cmdline = "python workspace_tools/make.py -m %s -t %s -c --silent %s -n %s " % (link["target"], toolchain, test_lib_switch, ",".join(test_names))
|
||||
cmdline = "python tools/make.py -m %s -t %s -c --silent %s -n %s " % (link["target"], toolchain, test_lib_switch, ",".join(test_names))
|
||||
print "Executing: " + cmdline
|
||||
if not dry_run:
|
||||
if os.system(cmdline) != 0:
|
||||
sys.exit(1)
|
||||
|
||||
def run_test_testsuite(dry_run):
|
||||
cmdline = "python workspace_tools/singletest.py --version"
|
||||
cmdline = "python tools/singletest.py --version"
|
||||
print "Executing: " + cmdline
|
||||
if not dry_run:
|
||||
if os.system(cmdline) != 0:
|
||||
|
|
|
|||
|
|
@ -287,7 +287,7 @@ from buildbot.config import BuilderConfig
|
|||
c['builders'] = []
|
||||
|
||||
copy_private_settings = ShellCommand(name = "copy private_settings.py",
|
||||
command = "cp ../private_settings.py workspace_tools/private_settings.py",
|
||||
command = "cp ../private_settings.py tools/private_settings.py",
|
||||
haltOnFailure = True,
|
||||
description = "Copy private_settings.py")
|
||||
|
||||
|
|
@ -303,7 +303,7 @@ for target_name, toolchains in OFFICIAL_MBED_LIBRARY_BUILD:
|
|||
# Adding all chains for target
|
||||
for toolchain in toolchains:
|
||||
build_py = BuildCommand(name = "Build %s using %s" % (target_name, toolchain),
|
||||
command = "python workspace_tools/build.py -m %s -t %s" % (target_name, toolchain),
|
||||
command = "python tools/build.py -m %s -t %s" % (target_name, toolchain),
|
||||
haltOnFailure = True,
|
||||
warnOnWarnings = True,
|
||||
description = "Building %s using %s" % (target_name, toolchain),
|
||||
|
|
@ -314,12 +314,12 @@ for target_name, toolchains in OFFICIAL_MBED_LIBRARY_BUILD:
|
|||
|
||||
if target_name in OFFICIAL_MBED_TESTBED_SUPPORTED_HARDWARE:
|
||||
copy_example_test_spec_json = ShellCommand(name = "Copy example_test_spec.json",
|
||||
command = "cp ../example_test_spec.json workspace_tools/data/example_test_spec.json",
|
||||
command = "cp ../example_test_spec.json tools/data/example_test_spec.json",
|
||||
haltOnFailure = True,
|
||||
description = "Copy example_test_spec.json")
|
||||
|
||||
autotest_py = ShellCommand(name = "Running autotest.py for %s" % (target_name),
|
||||
command = "python workspace_tools/autotest.py workspace_tools/data/example_test_spec.json",
|
||||
command = "python tools/autotest.py tools/data/example_test_spec.json",
|
||||
haltOnFailure = True,
|
||||
description = "Running autotest.py")
|
||||
|
||||
|
|
@ -337,12 +337,12 @@ for target_name, toolchains in OFFICIAL_MBED_LIBRARY_BUILD:
|
|||
factory=mbed_build))
|
||||
|
||||
# copy_example_test_spec_json = ShellCommand(name = "Copy example_test_spec.json",
|
||||
# command = "cp ../example_test_spec.json workspace_tools/data/example_test_spec.json",
|
||||
# command = "cp ../example_test_spec.json tools/data/example_test_spec.json",
|
||||
# haltOnFailure = True,
|
||||
# description = "Copy example_test_spec.json")
|
||||
|
||||
singletest_py = TestCommand(name = "Running Target Tests",
|
||||
command = "python workspace_tools/singletest.py -i workspace_tools/test_spec.json -M workspace_tools/muts_all.json",
|
||||
command = "python tools/singletest.py -i tools/test_spec.json -M tools/muts_all.json",
|
||||
haltOnFailure = True,
|
||||
warnOnWarnings = True,
|
||||
description = "Running Target Tests",
|
||||
|
|
|
|||
|
|
@ -75,7 +75,7 @@ if __name__ == '__main__':
|
|||
action="store_true",
|
||||
dest="supported_ides_html",
|
||||
default=False,
|
||||
help="writes workspace_tools/export/README.md")
|
||||
help="writes tools/export/README.md")
|
||||
|
||||
(options, args) = parser.parse_args()
|
||||
|
||||
|
|
|
|||
|
|
@ -101,4 +101,4 @@ try:
|
|||
# settings file stored in the repository
|
||||
from tools.private_settings import *
|
||||
except ImportError:
|
||||
print '[WARNING] Using default settings. Define your settings in the file "workspace_tools/private_settings.py" or in "./mbed_settings.py"'
|
||||
print '[WARNING] Using default settings. Define your settings in the file "tools/private_settings.py" or in "./mbed_settings.py"'
|
||||
|
|
|
|||
|
|
@ -168,7 +168,7 @@ class Target:
|
|||
break
|
||||
else: # Attribute not found
|
||||
raise AttributeError("Attribute '%s' not found in target '%s'" % (attrname, self.name))
|
||||
# 'progen' needs the full path to the template (the path in JSON is relative to workspace_tools/export)
|
||||
# 'progen' needs the full path to the template (the path in JSON is relative to tools/export)
|
||||
return v if attrname != "progen" else self.__add_paths_to_progen(v)
|
||||
|
||||
# Return the value of an attribute
|
||||
|
|
|
|||
Loading…
Reference in New Issue