2019-11-27 17:21:53 +00:00
---
title: Optimize Flux queries
description: >
2019-11-27 21:16:56 +00:00
Optimize your Flux queries to reduce their memory and compute (CPU) requirements.
2019-11-27 17:21:53 +00:00
weight: 104
menu:
v2_0:
name: Optimize queries
parent: Query data
v2.0/tags: [query]
---
2019-11-27 21:16:56 +00:00
Optimize your Flux queries to reduce their memory and compute (CPU) requirements.
- [Start queries with pushdown functions ](#start-queries-with-pushdown-functions )
- [Avoid short window durations ](#avoid-short-window-durations )
- [Use "heavy" functions sparingly ](#use-heavy-functions-sparingly )
- [Balance time range and data precision ](#balance-time-range-and-data-precision )
2019-11-27 17:21:53 +00:00
## Start queries with pushdown functions
2019-11-27 21:16:56 +00:00
Some Flux functions can push their data manipulation down to the underlying
data source rather than storing and manipulating data in memory.
These are known as "pushdown" functions and using them correctly can greatly
reduce the amount of memory necessary to run a query.
2019-11-27 17:21:53 +00:00
#### Pushdown functions
- [range() ](/v2.0/reference/flux/stdlib/built-in/transformations/range/ )
- [filter() ](/v2.0/reference/flux/stdlib/built-in/transformations/filter/ )
- [group() ](/v2.0/reference/flux/stdlib/built-in/transformations/group/ )
2020-07-07 16:12:52 +00:00
- [count() ](/v2.0/reference/flux/stdlib/built-in/transformations/aggregates/count/ )
- [sum() ](/v2.0/reference/flux/stdlib/built-in/transformations/aggregates/sum/ )
- [first() ](/v2.0/reference/flux/stdlib/built-in/transformations/selectors/first/ )
- [last() ](/v2.0/reference/flux/stdlib/built-in/transformations/selectors/last/ )
2019-11-27 17:21:53 +00:00
2019-11-27 21:16:56 +00:00
Use pushdown functions at the beginning of your query.
Once a non-pushdown function runs, Flux pulls data into memory and runs all
subsequent operations there.
2019-11-27 17:21:53 +00:00
##### Pushdown functions in use
```js
from(bucket: "example-bucket")
|> range(start: -1h) //
|> filter(fn: (r) => r.sensor == "abc123") // Pushed to the data source
|> group(columns: ["_field", "host"]) //
|> aggregateWindow(every: 5m, fn: max) //
|> filter(fn: (r) => r._value >= 90.0) // Run in memory
|> top(n: 10) //
```
2019-11-27 21:16:56 +00:00
## Avoid short window durations
2019-11-27 17:21:53 +00:00
Windowing (grouping data based on time intervals) is commonly used to aggregate and downsample data.
2019-11-27 21:16:56 +00:00
Increase performance by avoiding short window durations.
More windows require more compute power to evaluate which window each row should be assigned to.
2019-11-27 17:21:53 +00:00
Reasonable window durations depend on the total time range queried.
## Use "heavy" functions sparingly
2019-11-27 21:16:56 +00:00
The following functions use more memory or CPU than others.
Consider their necessity in your data processing before using them:
2019-11-27 17:21:53 +00:00
- [map() ](/v2.0/reference/flux/stdlib/built-in/transformations/map/ )
- [reduce() ](/v2.0/reference/flux/stdlib/built-in/transformations/aggregates/reduce/ )
- [window() ](/v2.0/reference/flux/stdlib/built-in/transformations/window/ )
- [join() ](/v2.0/reference/flux/stdlib/built-in/transformations/join/ )
- [union() ](/v2.0/reference/flux/stdlib/built-in/transformations/union/ )
- [pivot() ](/v2.0/reference/flux/stdlib/built-in/transformations/pivot/ )
{{% note %}}
2019-11-27 21:16:56 +00:00
We're continually optimizing Flux and this list may not represent its current state.
2019-11-27 17:21:53 +00:00
{{% /note %}}
2019-11-27 21:16:56 +00:00
## Balance time range and data precision
To ensure queries are performant, balance the time range and the precision of your data.
For example, if you query data stored every second and request six months worth of data,
results will include a minimum of ≈15.5 million points.
Flux must store these points in memory to generate a response.
2019-11-27 17:21:53 +00:00
2019-11-27 21:16:56 +00:00
To query data over large periods of time, create a task to [downsample data ](/v2.0/process-data/common-tasks/downsample-data/ ), and then query the downsampled data instead.