---
title: "CSV & JSON Data Cleaning and Deduplication"
slug: analyze
url: https://apyhub.com/giacomo-petrioli/service/analyze
provider: Giacomo Petrioli
categories: [Data Validation, Developer Tools]
tags: [data-quality, deduplication, csv-validation, record-analysis, schema-checking]
auth: api_key
---

# CSV & JSON Data Cleaning and Deduplication

Analyze CSV text or records for cleanup and duplicate checks. Configure key, required, and numeric columns before loading data into your system.

## Endpoints

| Method | Path | Description | Atoms |
| --- | --- | --- | --- |
| POST | `/analyze` | What it does Analyzes the submitted dataset from either structured records or raw csvtext input. Th… | 10 |
| GET | `/capabilities` | What it does Retrieves the capabilities response for this endpoint. The output is a JSON object, an… | 1 |

## About

## What it does
CSV & JSON Data Cleaning and Deduplication checks tabular data for common cleanup and deduplication issues. Send it either `records` as an array of objects or `csv_text`, then provide the columns you want treated as record keys with `key_columns`.

Use the built-in options to control how rows are normalised before analysis. `trim_strings` removes surrounding whitespace, `drop_blank_rows` skips empty rows, `numeric_columns` marks fields that should be treated as numbers, `required_columns` lists fields that must be present, and `case_sensitive_keys` controls whether key matching respects letter case.

The response schema is intentionally broad, so the service returns a structured analysis result without promising fixed field names. In practice, that makes it suitable for data validation pipelines, CSV ingestion checks, and duplicate detection before loading records into a database or analytics warehouse.

If you need to sanity-check exports from forms, spreadsheets, or ETL jobs, CSV & JSON Data Cleaning and Deduplication gives you a consistent way to inspect incoming rows and compare them against the key columns you care about.

## Usage

Authenticate with an ApyHub API key in the `apy-token` header.
Full docs and a live playground: https://apyhub.com/giacomo-petrioli/service/analyze