---
title: LAT Record Filtering
slug: QM3Dtz5Mo6aHsraNxxvHf
description: Implement record filtering in Ocient to manage and streamline data retrieval processes.
docTags: 
createdAt: Thu Jul 21 2022 17:05:13 GMT+0000 (Coordinated Universal Time)
updatedAt: Fri Apr 10 2026 20:39:08 GMT+0000 (Coordinated Universal Time)
---

:::hint{type="warning"}
Data Pipelines are now the preferred method for loading data into the Ocient® System. For details, see [Load Data](<./././Load Data.md>).
:::

Incoming records can optionally be filtered by a JMESPath expression added with an additional filter key in a pipeline configuration.

```json
{
    "transform": {
        "topics": {
            "my_topic": {
                "filter": "<jmespath-expression>",
                "tables": {
                    "my_table": {
                        "filter": "<jmespath-expression>",
                        "columns": {}
                    }
                }
            }
        }
    }
}
```

Records that pass through the filter (the filter expression evaluates to true) are processed as normal, while records that fail the filter (the filter expression evaluates to false) are dropped. Note that filters can be applied at the topic or table levels. A record needs to pass through all configured filters in order to be loaded to a table.

The filter JMESPath expression must evaluate to a `boolean` value. Examples of this are JMESPath comparators or functions that return a `boolean` like `contains`, `starts_with`, and `ends_with`.

## Example

Pipeline:

```json
{
    "transform": {
        "topics": {
            "topic0": {
                "filter": "integer0 == `2`",
                "tables": {
                    "table0": {
                        "filter": "integer1 == `3`",
                        "columns": {
                            "col0": "integer0",
                            "col1": "integer1"
                        }
                    }
                }
            }
        }
    }
}
```

Input:

```json
[
    {
        "integer0": 0,
        "integer1": 3
    },
    {
        "integer0": 2,
        "integer1": 1
    },
    {
        "integer0": 2,
        "integer1": 3
    }
]
```

Output:

```json
[
    {
        "integer0": 2,
        "integer1": 3
    }
]
```

## Related Links

[Ingest Data with Legacy LAT Reference](<././Ingest Data with Legacy LAT Reference.md>)
