Go to file
Christopher Haster fd72920853 Squashed 'features/filesystem/littlefs/littlefs/' changes from b2124a5ae..510cd13df
510cd13df Bumped minor version to v1.6
f5e053995 Fixed issue with release script non-standard version tags
066448055 Moved SPDX and license info into README
d66723ccf Merge pull request #81 from ARMmbed/simple-versioning
0234c7710 Simplified release process based on feedback
84adead98 Merge pull request #80 from FreddieChopin/fix-memory-leaks
0422c55b8 Fix memory leaks in lfs_mount and lfs_format
11ad3a241 Merge pull request #76 from ARMmbed/fix-corrupt-read
16318d003 Merge pull request #58 from dpgeorge/file-open-no-malloc
961fab70c Added file config structure and lfs_file_opencfg
041e90a1c Added handling for corrupt as initial state of blocks
f94d233de Merge pull request #74 from FreddieChopin/cxx-guards
577d777c2 Add C++ guards to public headers
c72d25203 Merge pull request #73 from FreddieChopin/fix-format-specifiers
7e67f9324 Use PRIu32 and PRIx32 format specifiers to fix warnings
5a17fa42e Fixed script issue with bash expansion inside makefile parameter
eed1eec5f Fixed information leaks through reused caches
4a8637032 Added quality of life improvements for main.c/test.c issues
ba4f17173 Merge pull request #57 from dpgeorge/fix-warnings
51346b8bf Fixed shadowed variable warnings
93a2e0bbe Merge pull request #62 from ARMmbed/license-bsd-3
6beff502e Changed license to BSD-3-Clause
c5e2b335d Added error when opening multiple files with a statically allocated buffer
015b86bc5 Fixed issue with trailing dots in file paths
9637b9606 Fixed lookahead overflow and removed unbounded lookahead pointers
89a7630d8 Fixed issue with lookahead trusting old lookahead blocks
43eac3083 Renamed test_parallel tests to test_interespersed
dbc3cb179 Fixed Travis rate-limit issue with Github requests
93ece2e87 Removed outdated note about moves and powerloss
d9c076d90 Removed the uninitialized read for invalid superblocks
58f3bb1f0 Merge pull request #37 from jrast/patch-1
f72f6d6a0 Removed out of date note about endianness
5c4ee2109 Added a note about the callback functions
155224600 Fixed Travis issue with deploy stage in PRs
9ee112a7c Fixed issue updating dir struct when extended dir chain
d9c36371e Fixed handling of root as target for create operations
1476181bd Added LFS_CONFIG for user provided configuration of the utils

git-subtree-dir: features/filesystem/littlefs/littlefs
git-subtree-split: 510cd13df99843174899aa3ddabcbc889c7872e8
2018-08-06 13:52:24 -05:00
emubd Squashed 'features/filesystem/littlefs/littlefs/' changes from b2124a5ae..510cd13df 2018-08-06 13:52:24 -05:00
tests Squashed 'features/filesystem/littlefs/littlefs/' changes from b2124a5ae..510cd13df 2018-08-06 13:52:24 -05:00
.gitignore Squashed 'features/filesystem/littlefs/littlefs/' changes from 5ee20e8..b2124a5 2018-02-22 18:40:26 -06:00
.travis.yml Squashed 'features/filesystem/littlefs/littlefs/' changes from b2124a5ae..510cd13df 2018-08-06 13:52:24 -05:00
DESIGN.md Squashed 'features/filesystem/littlefs/littlefs/' changes from 5ee20e8..b2124a5 2018-02-22 18:40:26 -06:00
LICENSE.md Squashed 'features/filesystem/littlefs/littlefs/' changes from b2124a5ae..510cd13df 2018-08-06 13:52:24 -05:00
Makefile Squashed 'features/filesystem/littlefs/littlefs/' changes from b2124a5ae..510cd13df 2018-08-06 13:52:24 -05:00
README.md Squashed 'features/filesystem/littlefs/littlefs/' changes from b2124a5ae..510cd13df 2018-08-06 13:52:24 -05:00
SPEC.md Squashed 'features/filesystem/littlefs/littlefs/' changes from 5ee20e8..b2124a5 2018-02-22 18:40:26 -06:00
lfs.c Squashed 'features/filesystem/littlefs/littlefs/' changes from b2124a5ae..510cd13df 2018-08-06 13:52:24 -05:00
lfs.h Squashed 'features/filesystem/littlefs/littlefs/' changes from b2124a5ae..510cd13df 2018-08-06 13:52:24 -05:00
lfs_util.c Squashed 'features/filesystem/littlefs/littlefs/' changes from b2124a5ae..510cd13df 2018-08-06 13:52:24 -05:00
lfs_util.h Squashed 'features/filesystem/littlefs/littlefs/' changes from b2124a5ae..510cd13df 2018-08-06 13:52:24 -05:00

README.md

The little filesystem

A little fail-safe filesystem designed for embedded systems.

   | | |     .---._____
  .-----.   |          |
--|o    |---| littlefs |
--|     |---|          |
  '-----'   '----------'
   | | |

Bounded RAM/ROM - The littlefs is designed to work with a limited amount of memory. Recursion is avoided and dynamic memory is limited to configurable buffers that can be provided statically.

Power-loss resilient - The littlefs is designed for systems that may have random power failures. The littlefs has strong copy-on-write guarantees and storage on disk is always kept in a valid state.

Wear leveling - Since the most common form of embedded storage is erodible flash memories, littlefs provides a form of dynamic wear leveling for systems that can not fit a full flash translation layer.

Example

Here's a simple example that updates a file named boot_count every time main runs. The program can be interrupted at any time without losing track of how many times it has been booted and without corrupting the filesystem:

#include "lfs.h"

// variables used by the filesystem
lfs_t lfs;
lfs_file_t file;

// configuration of the filesystem is provided by this struct
const struct lfs_config cfg = {
    // block device operations
    .read  = user_provided_block_device_read,
    .prog  = user_provided_block_device_prog,
    .erase = user_provided_block_device_erase,
    .sync  = user_provided_block_device_sync,

    // block device configuration
    .read_size = 16,
    .prog_size = 16,
    .block_size = 4096,
    .block_count = 128,
    .lookahead = 128,
};

// entry point
int main(void) {
    // mount the filesystem
    int err = lfs_mount(&lfs, &cfg);

    // reformat if we can't mount the filesystem
    // this should only happen on the first boot
    if (err) {
        lfs_format(&lfs, &cfg);
        lfs_mount(&lfs, &cfg);
    }

    // read current count
    uint32_t boot_count = 0;
    lfs_file_open(&lfs, &file, "boot_count", LFS_O_RDWR | LFS_O_CREAT);
    lfs_file_read(&lfs, &file, &boot_count, sizeof(boot_count));

    // update boot count
    boot_count += 1;
    lfs_file_rewind(&lfs, &file);
    lfs_file_write(&lfs, &file, &boot_count, sizeof(boot_count));

    // remember the storage is not updated until the file is closed successfully
    lfs_file_close(&lfs, &file);

    // release any resources we were using
    lfs_unmount(&lfs);

    // print the boot count
    printf("boot_count: %d\n", boot_count);
}

Usage

Detailed documentation (or at least as much detail as is currently available) can be found in the comments in lfs.h.

As you may have noticed, littlefs takes in a configuration structure that defines how the filesystem operates. The configuration struct provides the filesystem with the block device operations and dimensions, tweakable parameters that tradeoff memory usage for performance, and optional static buffers if the user wants to avoid dynamic memory.

The state of the littlefs is stored in the lfs_t type which is left up to the user to allocate, allowing multiple filesystems to be in use simultaneously. With the lfs_t and configuration struct, a user can format a block device or mount the filesystem.

Once mounted, the littlefs provides a full set of POSIX-like file and directory functions, with the deviation that the allocation of filesystem structures must be provided by the user.

All POSIX operations, such as remove and rename, are atomic, even in event of power-loss. Additionally, no file updates are actually committed to the filesystem until sync or close is called on the file.

Other notes

All littlefs have the potential to return a negative error code. The errors can be either one of those found in the enum lfs_error in lfs.h, or an error returned by the user's block device operations.

In the configuration struct, the prog and erase function provided by the user may return a LFS_ERR_CORRUPT error if the implementation already can detect corrupt blocks. However, the wear leveling does not depend on the return code of these functions, instead all data is read back and checked for integrity.

If your storage caches writes, make sure that the provided sync function flushes all the data to memory and ensures that the next read fetches the data from memory, otherwise data integrity can not be guaranteed. If the write function does not perform caching, and therefore each read or write call hits the memory, the sync function can simply return 0.

Reference material

DESIGN.md - DESIGN.md contains a fully detailed dive into how littlefs actually works. I would encourage you to read it since the solutions and tradeoffs at work here are quite interesting.

SPEC.md - SPEC.md contains the on-disk specification of littlefs with all the nitty-gritty details. Can be useful for developing tooling.

Testing

The littlefs comes with a test suite designed to run on a PC using the emulated block device found in the emubd directory. The tests assume a Linux environment and can be started with make:

make test

License

The littlefs is provided under the BSD-3-Clause license. See LICENSE.md for more information. Contributions to this project are accepted under the same license.

Individual files contain the following tag instead of the full license text.

SPDX-License-Identifier:    BSD-3-Clause

This enables machine processing of license information based on the SPDX License Identifiers that are here available: http://spdx.org/licenses/

Mbed OS - The easiest way to get started with littlefs is to jump into Mbed, which already has block device drivers for most forms of embedded storage. The littlefs is available in Mbed OS as the LittleFileSystem class.

littlefs-fuse - A FUSE wrapper for littlefs. The project allows you to mount littlefs directly on a Linux machine. Can be useful for debugging littlefs if you have an SD card handy.

littlefs-js - A javascript wrapper for littlefs. I'm not sure why you would want this, but it is handy for demos. You can see it in action here.