Data

Data Quality & Validation

Rigorous validation processes ensuring accuracy, consistency, and reliability across 32,000+ catalogued luxury assets with 91% algorithmic precision.

Data Quality & Validation

Rigorous validation processes ensuring accuracy, consistency, and reliability across 32,000+ catalogued luxury assets with 91% algorithmic precision.

Introduction

Data quality is the foundation of Prophetic's wealth intelligence. Every transaction, valuation, and market signal passes through our multi-stage validation framework before integration into the unified data layer.

Our commitment to institutional-grade accuracy means that only verified, cross-referenced data powers the Prophetic Score, ROI projections, and exit timing recommendations delivered to investors.

Note: Validation protocols are continuously refined based on market conditions and outcome monitoring.

Quality Overview

Validation Framework

json

{
  "framework": "multi-stage",
  "coverage": "all_segments",
  "assets_validated": "32,000+",
  "accuracy_rate": "91%",
  "status": "continuous"
}
```

### Core Principles

| Principle | Description | Impact |
|-----------|-------------|--------|
| **Accuracy** | True market reflection | Reliable valuations |
| **Consistency** | Standardised formats across segments | Cross-segment comparability |
| **Completeness** | Essential fields verified | Comprehensive asset profiles |
| **Timeliness** | Appropriate freshness per segment | Relevant market intelligence |

> **Important:** All data meets quality thresholds before use in any Prophetic output.

---

## Validation Pipeline

### Processing Stages

Every data point passes through a four-stage validation pipeline before reaching the unified data layer:
```
VALIDATION FLOW
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

  Ingestion    Validation    Classification    Output
      
      
  ┌───────┐    ┌───────┐      ┌───────┐     ┌───────┐
  │Capture│ │Verify │Classify│ │Deliver│
  └───────┘    └───────┘      └───────┘     └───────┘
  
  Raw data     Format,        Quality        Production
  from         range,         tier           ready
  sources      consistency    assignment     output

━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
```

### Stage Details

| Stage | Process | Outcome |
|-------|---------|---------|
| **Ingestion** | Raw data capture from all source categories | Normalised input format |
| **Validation** | Automated checks for format, range, consistency | Pass/fail determination |
| **Classification** | Quality tier assignment based on verification depth | Confidence level tagged |
| **Output** | Integration into unified layer | Production-ready data |

> **Note:** Each data point receives a validation status before integration.

---

## Quality Tiers

### Classification System

Prophetic assigns every data point to one of four quality tiers based on verification depth and source confirmation:
```
QUALITY TIER DISTRIBUTION
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

Tier          Distribution              Status
─────────────────────────────────────────────────
Verified      ████████████████████████  Full use
Confirmed     ██████████████████░░░░░░  Standard
Provisional   ██████████░░░░░░░░░░░░░░  Limited
Excluded      ░░░░░░░░░░░░░░░░░░░░░░░░  Not used

━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

Tier Definitions

Tier

Definition

Platform Usage

Confidence

Verified

Multi-source confirmed, cross-referenced

All features including Prophetic Score

High

Confirmed

Single authoritative source validated

Standard valuations and analytics

Moderate

Provisional

Pending additional confirmation

Flagged in outputs, limited use

Low

Excluded

Below quality threshold

Not displayed or used

None

json

{
  "asset_quality": {
    "tier": "verified",
    "sources_matched": 3,
    "confidence": "high",
    "last_validated": "2025-01-28"
  }
}
```

> **Tip:** Ask Prophetic about the quality tier behind any valuation or score.

---

## Validation Checks

### Automated Verification Suite

Every data point undergoes parallel automated checks before tier assignment:

| Check Type | Purpose | Example |
|------------|---------|---------|
| **Format** | Structure compliance | Date formats, currency codes |
| **Range** | Value plausibility | Price within historical bounds |
| **Consistency** | Cross-field alignment | Condition grade matches price |
| **Duplicate** | Redundancy detection | Same asset from multiple sources |
| **Temporal** | Chronological validity | Transaction date logic |

### Check Architecture
```
PARALLEL VALIDATION
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

         ┌─────────────┐
         Data Point 
         └──────┬──────┘
                
    ┌───────┬───┴───┬───────┐
    
┌──────┐┌──────┐┌──────┐┌──────┐
│Format││Range ││Consis││Duplic│
│Check ││Check ││Check ││Check 
└──┬───┘└──┬───┘└──┬───┘└──┬───┘
    
    └───────┴───┬───┴───────┘
                
         ┌─────────────┐
         Result    
         Pass/Fail  
         └─────────────┘

━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
```

> **Note:** Multiple checks run in parallel for speed without sacrificing thoroughness.

---

## Cross-Source Verification

### Multi-Source Confirmation

Data confidence increases significantly when multiple independent sources confirm the same information:
```
SOURCE VERIFICATION IMPACT
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

Sources              Confidence Level
─────────────────────────────────────────────────
Single Source        ████████░░░░░░░░░░ Baseline
Two Sources          ████████████████░░ Elevated
Three+ Sources       ████████████████████ High

━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
```

### Discrepancy Resolution

| Scenario | Resolution Process |
|----------|---------------------|
| Minor variance (<5%) | Weighted average based on source reliability |
| Significant variance (5-15%) | Manual review triggered |
| Major conflict (>15%) | Quarantined pending investigation |

> **Important:** Cross-source verification is the primary driver of "Verified" tier classification.

---

## Segment-Specific Standards

### Validation Focus by Segment

Each segment has tailored validation criteria reflecting its unique market characteristics:

| Segment | Primary Validation Focus | Critical Fields |
|---------|--------------------------|-----------------|
| **Watches** | Reference accuracy, condition grading | Ref. number, movement, box/papers |
| **Contemporary Art** | Artist attribution, provenance chain | Artist ID, exhibition history |
| **Sneakers** | Model authenticity, size verification | SKU, colourway, authentication |
| **Fine Wines** | Vintage accuracy, storage conditions | Producer, vintage, provenance |
| **Luxury Bags** | Model identification, material verification | Reference, leather, hardware |
| **High Jewellery** | Certification validation, grading accuracy | Lab cert, carats, clarity |
| **Collectible Cards** | Grade verification, population data | PSA/BGS grade, population |
| **Automobiles** | VIN validation, history verification | VIN, mileage, service records |
| **Real Estate** | Location accuracy, specification verification | Address, surface, amenities |

### Validation Depth by Segment
```
SEGMENT VALIDATION DEPTH
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

Segment              Depth
─────────────────────────────────────────────────
Watches              ██████████████████████ Deep
Sneakers             ████████████████████░░ Strong
Wines & Spirits      ████████████████████░░ Strong
Collectible Cards    ██████████████████░░░░ Solid
Contemporary Art     ██████████████████░░░░ Solid
Luxury Bags          ████████████████░░░░░░ Good
High Jewellery       ████████████████░░░░░░ Good
Automobiles          ██████████████░░░░░░░░ Moderate
Real Estate          ██████████████░░░░░░░░ Moderate

━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
```

---

## Anomaly Detection

### Outlier Identification

Statistical models continuously monitor for data points that fall outside expected ranges:
```
ANOMALY DETECTION
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

Value
    
    Flagged outlier
    ┌────────────────────────────────────┐
    │░░░░░░░ Expected Range ░░░░░░░░░░░░░│
    └────────────────────────────────────┘
    Flagged outlier
    └──────────────────────────────────────────▶

━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
```

### Anomaly Response Protocol

| Anomaly Type | Detection Method | Response |
|--------------|------------------|----------|
| **Price spike** | >2 standard deviations from mean | Review triggered |
| **Volume surge** | Unusual transaction frequency | Pattern analysis |
| **Data conflict** | Source disagreement | Source verification |
| **Temporal anomaly** | Illogical date sequences | Quarantine |

> **Note:** All anomalies are quarantined until reviewed and resolved.

---

## Confidence Indicators

### Confidence Level Framework

Every Prophetic output includes a confidence indicator based on underlying data quality:
```
CONFIDENCE LEVELS
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

Level       Foundation              Interpretation
─────────────────────────────────────────────────
High        Multi-source verified   Strong reliability
Moderate    Single-source confirmed Standard confidence  
Limited     Provisional data        Use with context

━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

Confidence in Outputs

json

{
  "valuation_confidence": {
    "level": "high",
    "basis": "3 sources confirmed",
    "tier": "verified",
    "recommended_use": "all applications"
  }
}
```

> **Tip:** Ask Prophetic about confidence levels for any specific output.

---

## Market Scout Integration

### AI-Powered Verification Layer

Market Scout adds a final verification layer using AI cross-referencing before any insight is published:
```
MARKET SCOUT VALIDATION
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

  Prophetic Data     Market Scout
                          (AI verification)
                               
                     Real-time fact-checking
                               
                     Validated for publication

━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
```

| Function | Description |
|----------|-------------|
| Fact-checking | Verify data points against current market |
| Price validation | Cross-reference with live listings |
| Anomaly flagging | Identify statistical outliers |

> **Important:** Every published insight passes Market Scout validation.

---

## Freshness Monitoring

### Data Currency Tracking
```
FRESHNESS STATUS
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

Status      Description              Indicator
─────────────────────────────────────────────────
Current     Within optimal window    Active
Recent      Acceptable range         Valid
Ageing      Approaching threshold    Monitor
Stale       Refresh needed           ⚠️ Caution

━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
```

> **Note:** Prophetic indicates freshness status for all outputs.

---

## Quality Transparency

### What We Communicate

| Aspect | Transparency |
|--------|--------------|
| Quality tier | ✅ Indicated on every output |
| Confidence level | ✅ Shared with all valuations |
| Freshness status | ✅ Timestamped |
| Source count | ✅ Disclosed |
| Validation methodology | ❌ Proprietary |

### Quality Summary in Outputs
```
QUALITY OUTPUT EXAMPLE
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

┌───────────────────────────────────────────┐
Quality Tier:     Verified        
Confidence:       High            
Freshness:        Current         
Sources:          3 confirmed     
Market Scout:     Validated       
└───────────────────────────────────────────┘

━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
```

---

## Continuous Improvement

### Quality Evolution

Validation protocols evolve based on outcome monitoring and market changes:
```
QUALITY TRAJECTORY
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

Accuracy
    
91% ●───────●
    ●─────┘
    ●─────┘
    ●─────┘
    ●─────┘
    └──────────────────────────────────────────▶
       2023         2024         2025

━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

Improvement Activities


Activity

Purpose

Frequency

Accuracy monitoring

Track prediction vs. outcome

Continuous

Protocol updates

Refine validation rules

Quarterly

Source expansion

Add new verified sources

Ongoing

Anomaly analysis

Learn from flagged cases

Weekly

GDPR Compliance

Data Protection Standards

json

{
  "compliance": {
    "gdpr": true,
    "data_architecture": "Distributed fragments",
    "personal_data": false,
    "anonymisation": "Full transaction anonymisation",
    "retention": "EU regulation compliant"
  }
}
```

> **Note:** No personal data is stored. All transaction data is anonymised.

---

## Limitations

### Quality Boundaries
```
VALIDATION SCOPE
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

VALIDATION COVERS:
   Public auction results
   Verified marketplace transactions
   Disclosed secondary market sales
   Authenticated source partnerships
   AI cross-referenced market data

VALIDATION LIMITED FOR:
   Private negotiations
   Undisclosed transactions
   Unverified sources
   Off-market activity

━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

Important: Quality reflects verifiable market activity. Confidence levels are adjusted accordingly when data depth varies.

Need help? Contact Support

Join our Discord Community

Questions? Contact Sales