Skip to main content

Connector Usage Guide

Complete guides for setting up different connector types, best practices, and troubleshooting.

Step-by-Step Guides​

S3-Compatible Connector Setup​

Step 1: Create Connector

  • Navigate to Connectors section
  • Click "New Integration"
  • Select "S3-Compatible" connector type

Step 2: Configure Connection

  • Enter endpoint URL
  • Enter bucket name
  • Configure region (if applicable)
  • Set path prefix (optional)

Step 3: Configure Credentials

  • Enter access key ID
  • Enter secret access key
  • Validate credentials

Step 4: Validate and Save

  • Test connection
  • Validate access
  • Save connector

Oracle Connector Setup​

Step 1: Create Connector

  • Navigate to Connectors section
  • Click "New Integration"
  • Select "Oracle" connector type

Step 2: Configure Connection

  • Enter database host
  • Enter port (default 1521)
  • Enter database name
  • Enter service name

Step 3: Configure Credentials

  • Enter database username
  • Enter database password
  • Validate credentials

Step 4: Validate and Save

  • Test connection
  • Validate access
  • Save connector

Configuration Examples​

S3-Compatible Configuration​

connector:
  type: s3-compatible
  endpoint: https://s3.amazonaws.com
  bucket: my-data-bucket
  region: us-east-1
  access_key: YOUR_ACCESS_KEY
  secret_key: YOUR_SECRET_KEY
  path_prefix: /datasets/

Oracle Configuration​

connector:
  type: oracle
  host: oracle.example.com
  port: 1521
  database: ORCL
  service_name: ORCL
  username: myuser
  password: mypassword

Security Best Practices​

Credential Management:

  • Use least-privilege credentials
  • Rotate credentials regularly
  • Never share credentials
  • Use separate credentials per environment

Network Security:

  • Use secure connections (HTTPS, TLS)
  • Restrict network access
  • Use VPN or private networks when possible
  • Monitor connection logs

Access Control:

  • Implement role-based access
  • Limit connector access to authorized users
  • Audit connector usage
  • Review access regularly

Common Troubleshooting​

Issue: Connection Fails

  • Symptom: Cannot connect to data source
  • Possible Causes:
    • Invalid credentials
    • Network issues
    • Incorrect endpoint
  • Solutions:
    • Verify credentials
    • Check network connectivity
    • Verify endpoint configuration
    • Check firewall rules

Issue: Authentication Fails

  • Symptom: Authentication error
  • Possible Causes:
    • Invalid credentials
    • Expired credentials
    • Insufficient permissions
  • Solutions:
    • Verify credentials
    • Check credential expiration
    • Verify permissions
    • Update credentials if needed

Issue: Cannot Access Data

  • Symptom: Connection works but cannot read data
  • Possible Causes:
    • Insufficient permissions
    • Incorrect path/table name
    • Data format issues
  • Solutions:
    • Check permissions
    • Verify path/table names
    • Check data format
    • Review error messages

Issue: Schema Detection Fails

  • Symptom: Cannot detect data schema
  • Possible Causes:
    • Unsupported data format
    • Corrupted files
    • Large file size
  • Solutions:
    • Check data format
    • Verify file integrity
    • Check file size limits
    • Review file structure

Next Steps​