Full History files not importing properly

[Benjamin-Walpole]

Describe the bug

I start the import okay i even get the small banner telling me its started, the logs in network when i click ctr + shift + i and the docker logs show its working fine but the progress bar won' update. As well as this, in the import history, it'll say success (0/x) and when looking on the all stats page no data is displayed for the year the data is for.

Expected behavior

File imported successfully and is shown on the All stats page

Additional context

Please paste the docker-compose file you're using to host YourSpotify and their logs (you can skip mongo logs). If your issue have anything related to other tools, please paste their config too.
Docker compose:
turtleshell@raspberrypi:~/your_spotify $ cat docker-compose.yml
services:
server:
image: yooooomi/your_spotify_server
container_name: your_spotify_server
restart: always
ports:
- "8090:8080"
environment:
API_ENDPOINT: https://api.benwalpole.com
CLIENT_ENDPOINT: https://benwalpole.com
NODE_ENV: production
COOKIE_SAMESITE: "none"
COOKIE_SECURE: "true"
TRUST_PROXY: "true"
SPOTIFY_PUBLIC: XXXXX
SPOTIFY_SECRET: XXXXX
depends_on:
- mongo

mongo:
image: mongo:4.4.6
container_name: your_spotify_mongo
restart: always
volumes:
- ./your_spotify_db:/data/db

web:
image: yooooomi/your_spotify_client
container_name: your_spotify_web
restart: always
ports:
- "3010:3000"
environment:
API_ENDPOINT: https://api.benwalpole.com

Start of import log: [info] [4/6/2026, 3:05:02 PM] [DbLoop] starting for 1 users
[info] [4/6/2026, 3:05:02 PM] [XWalpole]: refreshing...
[info] [4/6/2026, 3:05:11 PM] [XWalpole]: 0 tracks, 0 albums, 0 artists
[info] [4/6/2026, 3:07:11 PM] [DbLoop] starting for 1 users
[info] [4/6/2026, 3:07:11 PM] [XWalpole]: refreshing...
[info] [4/6/2026, 3:07:20 PM] [XWalpole]: 0 tracks, 0 albums, 0 artists
[info] [4/6/2026, 3:09:20 PM] [DbLoop] starting for 1 users
[info] [4/6/2026, 3:09:20 PM] [XWalpole]: refreshing...
[info] [4/6/2026, 3:09:29 PM] [XWalpole]: 0 tracks, 0 albums, 0 artists
[info] [4/6/2026, 3:10:03 PM] Importing... (0/15417)
[info] [4/6/2026, 3:10:03 PM] Track Girl on Fire - Alicia Keys was passed, only listened for 12 seconds
[info] [4/6/2026, 3:10:03 PM] Importing... (1/15417)
[info] [4/6/2026, 3:10:03 PM] Track Girl on Fire - Alicia Keys was passed, only listened for 2 seconds
[info] [4/6/2026, 3:10:03 PM] Importing... (2/15417)
[info] [4/6/2026, 3:10:03 PM] Importing... (3/15417)
[info] [4/6/2026, 3:10:03 PM] Importing... (4/15417)
[info] [4/6/2026, 3:10:03 PM] Track Firework - Katy Perry was passed, only listened for 0 seconds
[info] [4/6/2026, 3:10:03 PM] Importing... (5/15417)
[info] [4/6/2026, 3:10:03 PM] Track Almost Is Never Enough - Ariana Grande was passed, only listened for 2 seconds
[info] [4/6/2026, 3:10:03 PM] Importing... (6/15417)
[info] [4/6/2026, 3:10:03 PM] Track Almost Is Never Enough - Ariana Grande was passed, only listened for 0 seconds
[info] [4/6/2026, 3:10:03 PM] Importing... (7/15417)
[info] [4/6/2026, 3:10:03 PM] Track Like I Can - Sam Smith was passed, only listened for 0 seconds
[info] [4/6/2026, 3:10:03 PM] Importing... (8/15417)
[info] [4/6/2026, 3:10:03 PM] Importing... (9/15417)
[info] [4/6/2026, 3:10:03 PM] Importing... (10/15417)
[info] [4/6/2026, 3:10:03 PM] Track Girl on Fire - Alicia Keys was passed, only listened for 18 seconds
[info] [4/6/2026, 3:10:03 PM] Importing... (11/15417)
[info] [4/6/2026, 3:10:03 PM] Track Girl on Fire - Alicia Keys was passed, only listened for 18 seconds
[info] [4/6/2026, 3:10:03 PM] Importing... (12/15417)
[info] [4/6/2026, 3:10:03 PM] Track Whoregasm - cupcakKe was passed, only listened for 3 seconds
[info] [4/6/2026, 3:10:03 PM] Importing... (13/15417)
[info] [4/6/2026, 3:10:03 PM] Importing... (14/15417)
[info] [4/6/2026, 3:10:03 PM] Importing... (15/15417)
[info] [4/6/2026, 3:10:03 PM] Track Lemon Pepper - cupcakKe was passed, only listened for 4 seconds
[info] [4/6/2026, 3:10:03 PM] Importing... (16/15417)
[info] [4/6/2026, 3:10:03 PM] Track Mistress - cupcakKe was passed, only listened for 1 seconds
[info] [4/6/2026, 3:10:03 PM] Importing... (17/15417)
[info] [4/6/2026, 3:10:03 PM] Track Keep Hoes Alive - cupcakKe was passed, only listened for 2 seconds
[info] [4/6/2026, 3:10:03 PM] Importing... (18/15417)
[info] [4/6/2026, 3:10:03 PM] Track Biggie Smalls - cupcakKe was passed, only listened for 21 seconds
[info] [4/6/2026, 3:10:03 PM] Importing... (19/15417)
[info] [4/6/2026, 3:10:03 PM] Track Cinnamon Toast Crunch - cupcakKe was passed, only listened for 26 seconds
[info] [4/6/2026, 3:10:03 PM] Importing... (20/15417)
[info] [4/6/2026, 3:10:03 PM] Importing... (21/15417)
[info] [4/6/2026, 3:10:03 PM] Importing... (22/15417)
[info] [4/6/2026, 3:10:03 PM] Importing... (23/15417)
[info] [4/6/2026, 3:10:03 PM] Importing... (24/15417)
[info] [4/6/2026, 3:10:03 PM] Importing... (25/15417)
[info] [4/6/2026, 3:10:03 PM] Track jar of hearts - Christina Perri was passed, only listened for 10 seconds
[info] [4/6/2026, 3:10:03 PM] Importing... (26/15417)
[info] [4/6/2026, 3:10:03 PM] Track Boys Will Be Boys - Paulina Rubio was passed, only listened for 10 seconds
[info] [4/6/2026, 3:10:03 PM] Importing... (27/15417)
[info] [4/6/2026, 3:10:03 PM] Track Chandelier - Sia was passed, only listened for 1 seconds
[info] [4/6/2026, 3:10:03 PM] Importing... (28/15417)
[info] [4/6/2026, 3:10:03 PM] Importing... (29/15417)
[info] [4/6/2026, 3:10:03 PM] Track Halo - Beyoncé was passed, only listened for 1 seconds

End of Import log: [info] [4/6/2026, 4:02:21 PM] Importing... (15414/15417)
[info] [4/6/2026, 4:02:21 PM] Importing... (15415/15417)
[info] [4/6/2026, 4:02:21 PM] Importing... (15416/15417)
GET /imports 304 11.902 ms - -
GET /imports 304 11.912 ms - -
GET /imports 304 14.660 ms - -
GET /imports 304 13.386 ms - -
GET /imports 304 11.786 ms - -
GET /imports 304 11.842 ms - -

Screenshots

Shared link

https://benwalpole.com/settings/account?gname=Today&token=f5d35926-2c53-4a1b-bbfa-e53e0b645dfe

[cha0ticcoder]

Having this exact problem too, imported around 76000 Songs and none of them show up.
Only importing a single file with around 4500 Songs does only import the times i listened to the songs but doesnt show the actual songs.

[otisdog8]

I suspect I also hit this issue, I think it could be related to #594 and #597, specifically my suspicion is that the import could be missing fields, which caused the above issues. #598 then fixes the crashes by just filtering out the songs missing that field. If I have time over the next few days I'll try and confirm this.

[Rekkertt]

Based on my experience it looks like a API limit of sorts.
You can only do one or two .json file(s) (depending on the size) each day, I guess..?

[cha0ticcoder]

In my case, even importing a single file led to the data not being properly displayed. :/

[Rekkertt]

In my case, even importing a single file led to the data not being properly displayed. :/

Maybe cut your file in half (or smaller).
I know thats not userfriendly, but only the dev can make it clear in the logs or fix this issue.

[BlakeJC94]

I'm getting the same issue. I tried downgrading to 1.17.0, but I'm getting these logs after initiating and extended history import:

Response log

POST /import/full-privacy 200 542.012 ms - 25
GET /imports 200 3.430 ms - 852
[error] [5/6/2026, 4:55:22 AM] Retrying crashed promise, 9/10, retrying in 30 seconds...
[error] [5/6/2026, 4:55:23 AM] Retrying crashed promise, 1/10, retrying in 30 seconds...
GET /imports 304 3.610 ms - -
GET /imports 304 3.345 ms - -
GET /imports 304 3.346 ms - -
GET /imports 304 3.194 ms - -
GET /imports 304 3.281 ms - -
GET /imports 304 3.298 ms - -
GET /imports 304 3.358 ms - -
GET /imports 304 3.690 ms - -
GET /imports 304 3.172 ms - -
GET /imports 304 3.755 ms - -
GET /imports 304 3.312 ms - -
GET /imports 304 3.309 ms - -
GET /imports 304 3.281 ms - -
GET /imports 304 3.324 ms - -
GET /imports 304 3.326 ms - -
[error] [5/6/2026, 4:55:52 AM] Retrying crashed promise, 10/10
[info] [5/6/2026, 4:55:52 AM] Response of failed request Too many requests
[info] [5/6/2026, 4:55:52 AM] There appears to be issues with either your internet connection or Spotify
[error] [5/6/2026, 4:55:52 AM] [consistencypls]: Error during refresh el [AxiosError]: Request failed with status code 429
    at eY (/app/apps/server/build/index.js:11:913238)
    at IncomingMessage.<anonymous> (/app/apps/server/build/index.js:13:11787)
    at IncomingMessage.emit (node:events:520:35)
    at endReadableNT (node:internal/streams/readable:1701:12)
    at process.processTicksAndRejections (node:internal/process/task_queues:89:21)
    at tQ.request (/app/apps/server/build/index.js:13:24288)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async Object.execQueue (/app/apps/server/build/index.js:32:62884) {
  code: 'ERR_BAD_REQUEST',
  config: {
    transitional: {
      silentJSONParsing: true,
      forcedJSONParsing: true,
      clarifyTimeoutError: false
    },
    adapter: [ 'xhr', 'http', 'fetch' ],
    transformRequest: [ [Function (anonymous)] ],
    transformResponse: [ [Function (anonymous)] ],
    timeout: 0,
    xsrfCookieName: 'XSRF-TOKEN',
    xsrfHeaderName: 'X-XSRF-TOKEN',
    maxContentLength: -1,
    maxBodyLength: -1,
    env: { FormData: [Function], Blob: [class Blob] },
    validateStatus: [Function: validateStatus],
    headers: Object [AxiosHeaders] {
      Accept: 'application/json, text/plain, */*',
      'Content-Type': 'application/json',
      Authorization: 'Bearer BQCtxDjO_lNRr3tbbhM5hIDCil4f2GgWtJjmVNJLy9_0WR5VXiB8uuiaKDGTsYjRD8QDUi6ZF1DRxdJGFkSVknfTZObV-77RATn1NI8RylOb0zhhup40_bgp0JdVzAxhdBOKSJLvtKrv4QLpmi_gle_f0YZ7iZIY_GPabBaUbAwYWqjO4tBdmgxfOJ-tDNfXMxX1gN9EQZv3BFJ__K4N0ccPZv_5RY1q-N5EWxcLKgo8GL_W097e8SHWJ_lyMODSdsxn-6EMpSqCTikmyOG8_AjUuGmwWKSXEOKNb3fN7rAdb6iUASZGNNrh7D8',
      'User-Agent': 'axios/1.13.2',
      'Accept-Encoding': 'gzip, compress, deflate, br'
    },
    baseURL: 'https://api.spotify.com/v1',
    method: 'get',
    url: 'https://api.spotify.com/v1/tracks?ids=61fnOBpTBUPjyeQVobKJqL,47yLfurzqke5gcdVG9PXYf,5xGm4rLxe7nZWswPc3BU3s,3Jti8kGqr6mPWT304JUTr4,5tpWDyyOr4GDcpNYsn8LMI,2GSIXbSNZRF2mUl4LnoOeD,50DyQQ9sog4azZmF5tSJlK,1RFLkDNFSUKB9n7USEdw3X,7pBHLxLuo0epUw53Wij0Pq,1vZ0MPp1LXfa1AZDCWRhOZ,0nsias9MU5qcRAlfytAXsc,2nlivHG7sBn9C22SBhzuQp,5n6gfU5WOaMazDwejuJW35,0YS5kV6GJT6t5cDc4Vgsgp,5KLcIahbdBJeZ8tHAyYMpN,3gF64oRdu5O5m5Eucx4JY1,4GPLb3A6MbjzlimKcqGJQl,3dZV4HZQwkw8ktt4SsjBJW,3dZV4HZQwkw8ktt4SsjBJW,0lwkzF4dDxLp8HMVSQjpFf,3nQsESv9BOJZSzFCxfpWpB,193jGhmmCTDj8hBThUPnRA,09ttHg3ZNVgDlYBZa1ZBw0,53XLfXbVPTY7lO36pOBvIu,31ZJBAyjI7XWBpIZeMbXXC,784HPjRj1dFr1XfdEnJfI0,7ryc6Dg8IjEtDXSlNC6NrL,2Q7r5HzvtVXD9v4apv95Xn,0uowUdDOAcdicQTNWR6zWa,20Mgn25bgsia8Dn9CLxAXE',
    allowAbsoluteUrls: true,
    data: undefined
  },
  request: <ref *1> ClientRequest {
    _events: [Object: null prototype] {
      abort: [Function (anonymous)],
      aborted: [Function (anonymous)],
      connect: [Function (anonymous)],
      error: [Function (anonymous)],
      socket: [Function (anonymous)],
      timeout: [Function (anonymous)],
      finish: [Function: requestOnFinish]
    },
    _eventsCount: 7,
    _maxListeners: undefined,
    outputData: [],
    outputSize: 0,
    writable: true,
    destroyed: true,
    _last: true,
    chunkedEncoding: false,
    shouldKeepAlive: true,
    maxRequestsOnConnectionReached: false,
    _defaultKeepAlive: true,
    useChunkedEncodingByDefault: false,
    sendDate: false,
    _removedConnection: false,
    _removedContLen: false,
    _removedTE: false,
    strictContentLength: false,
    _contentLength: 0,
    _hasBody: true,
    _trailer: '',
    finished: true,
    _headerSent: true,
    _closed: true,
    _header: 'GET /v1/tracks?ids=61fnOBpTBUPjyeQVobKJqL,47yLfurzqke5gcdVG9PXYf,5xGm4rLxe7nZWswPc3BU3s,3Jti8kGqr6mPWT304JUTr4,5tpWDyyOr4GDcpNYsn8LMI,2GSIXbSNZRF2mUl4LnoOeD,50DyQQ9sog4azZmF5tSJlK,1RFLkDNFSUKB9n7USEdw3X,7pBHLxLuo0epUw53Wij0Pq,1vZ0MPp1LXfa1AZDCWRhOZ,0nsias9MU5qcRAlfytAXsc,2nlivHG7sBn9C22SBhzuQp,5n6gfU5WOaMazDwejuJW35,0YS5kV6GJT6t5cDc4Vgsgp,5KLcIahbdBJeZ8tHAyYMpN,3gF64oRdu5O5m5Eucx4JY1,4GPLb3A6MbjzlimKcqGJQl,3dZV4HZQwkw8ktt4SsjBJW,3dZV4HZQwkw8ktt4SsjBJW,0lwkzF4dDxLp8HMVSQjpFf,3nQsESv9BOJZSzFCxfpWpB,193jGhmmCTDj8hBThUPnRA,09ttHg3ZNVgDlYBZa1ZBw0,53XLfXbVPTY7lO36pOBvIu,31ZJBAyjI7XWBpIZeMbXXC,784HPjRj1dFr1XfdEnJfI0,7ryc6Dg8IjEtDXSlNC6NrL,2Q7r5HzvtVXD9v4apv95Xn,0uowUdDOAcdicQTNWR6zWa,20Mgn25bgsia8Dn9CLxAXE HTTP/1.1\r\n' +
      'Accept: application/json, text/plain, */*\r\n' +
      'Content-Type: application/json\r\n' +
      'Authorization: Bearer BQCtxDjO_lNRr3tbbhM5hIDCil4f2GgWtJjmVNJLy9_0WR5VXiB8uuiaKDGTsYjRD8QDUi6ZF1DRxdJGFkSVknfTZObV-77RATn1NI8RylOb0zhhup40_bgp0JdVzAxhdBOKSJLvtKrv4QLpmi_gle_f0YZ7iZIY_GPabBaUbAwYWqjO4tBdmgxfOJ-tDNfXMxX1gN9EQZv3BFJ__K4N0ccPZv_5RY1q-N5EWxcLKgo8GL_W097e8SHWJ_lyMODSdsxn-6EMpSqCTikmyOG8_AjUuGmwWKSXEOKNb3fN7rAdb6iUASZGNNrh7D8\r\n' +
      'User-Agent: axios/1.13.2\r\n' +
      'Accept-Encoding: gzip, compress, deflate, br\r\n' +
      'Host: api.spotify.com\r\n' +
      'Connection: keep-alive\r\n' +
      '\r\n',
    _keepAliveTimeout: 0,
    _onPendingData: [Function: nop],
    agent: Agent {
      _events: [Object: null prototype],
      _eventsCount: 2,
      _maxListeners: undefined,
      options: [Object: null prototype],
      defaultPort: 443,
      protocol: 'https:',
      requests: [Object: null prototype] {},
      sockets: [Object: null prototype] {},
      freeSockets: [Object: null prototype],
      keepAliveMsecs: 1000,
      keepAlive: true,
      maxSockets: Infinity,
      maxFreeSockets: 256,
      scheduling: 'lifo',
      maxTotalSockets: Infinity,
      totalSocketCount: 1,
      agentKeepAliveTimeoutBuffer: 1000,
      maxCachedSessions: 100,
      _sessionCache: [Object],
      Symbol(shapeMode): false,
      Symbol(kCapture): false
    },
    socketPath: undefined,
    method: 'GET',
    maxHeaderSize: undefined,
    insecureHTTPParser: undefined,
    joinDuplicateHeaders: undefined,
    path: '/v1/tracks?ids=61fnOBpTBUPjyeQVobKJqL,47yLfurzqke5gcdVG9PXYf,5xGm4rLxe7nZWswPc3BU3s,3Jti8kGqr6mPWT304JUTr4,5tpWDyyOr4GDcpNYsn8LMI,2GSIXbSNZRF2mUl4LnoOeD,50DyQQ9sog4azZmF5tSJlK,1RFLkDNFSUKB9n7USEdw3X,7pBHLxLuo0epUw53Wij0Pq,1vZ0MPp1LXfa1AZDCWRhOZ,0nsias9MU5qcRAlfytAXsc,2nlivHG7sBn9C22SBhzuQp,5n6gfU5WOaMazDwejuJW35,0YS5kV6GJT6t5cDc4Vgsgp,5KLcIahbdBJeZ8tHAyYMpN,3gF64oRdu5O5m5Eucx4JY1,4GPLb3A6MbjzlimKcqGJQl,3dZV4HZQwkw8ktt4SsjBJW,3dZV4HZQwkw8ktt4SsjBJW,0lwkzF4dDxLp8HMVSQjpFf,3nQsESv9BOJZSzFCxfpWpB,193jGhmmCTDj8hBThUPnRA,09ttHg3ZNVgDlYBZa1ZBw0,53XLfXbVPTY7lO36pOBvIu,31ZJBAyjI7XWBpIZeMbXXC,784HPjRj1dFr1XfdEnJfI0,7ryc6Dg8IjEtDXSlNC6NrL,2Q7r5HzvtVXD9v4apv95Xn,0uowUdDOAcdicQTNWR6zWa,20Mgn25bgsia8Dn9CLxAXE',
    _ended: true,
    res: IncomingMessage {
      _events: [Object],
      _readableState: [ReadableState],
      _maxListeners: undefined,
      socket: null,
      httpVersionMajor: 1,
      httpVersionMinor: 1,
      httpVersion: '1.1',
      complete: true,
      rawHeaders: [Array],
      rawTrailers: [],
      joinDuplicateHeaders: undefined,
      aborted: false,
      upgrade: false,
      url: '',
      method: null,
      statusCode: 429,
      statusMessage: 'Too Many Requests',
      client: [TLSSocket],
      _consuming: false,
      _dumped: false,
      req: [Circular *1],
      _eventsCount: 4,
      responseUrl: 'https://api.spotify.com/v1/tracks?ids=61fnOBpTBUPjyeQVobKJqL,47yLfurzqke5gcdVG9PXYf,5xGm4rLxe7nZWswPc3BU3s,3Jti8kGqr6mPWT304JUTr4,5tpWDyyOr4GDcpNYsn8LMI,2GSIXbSNZRF2mUl4LnoOeD,50DyQQ9sog4azZmF5tSJlK,1RFLkDNFSUKB9n7USEdw3X,7pBHLxLuo0epUw53Wij0Pq,1vZ0MPp1LXfa1AZDCWRhOZ,0nsias9MU5qcRAlfytAXsc,2nlivHG7sBn9C22SBhzuQp,5n6gfU5WOaMazDwejuJW35,0YS5kV6GJT6t5cDc4Vgsgp,5KLcIahbdBJeZ8tHAyYMpN,3gF64oRdu5O5m5Eucx4JY1,4GPLb3A6MbjzlimKcqGJQl,3dZV4HZQwkw8ktt4SsjBJW,3dZV4HZQwkw8ktt4SsjBJW,0lwkzF4dDxLp8HMVSQjpFf,3nQsESv9BOJZSzFCxfpWpB,193jGhmmCTDj8hBThUPnRA,09ttHg3ZNVgDlYBZa1ZBw0,53XLfXbVPTY7lO36pOBvIu,31ZJBAyjI7XWBpIZeMbXXC,784HPjRj1dFr1XfdEnJfI0,7ryc6Dg8IjEtDXSlNC6NrL,2Q7r5HzvtVXD9v4apv95Xn,0uowUdDOAcdicQTNWR6zWa,20Mgn25bgsia8Dn9CLxAXE',
      redirects: [],
      Symbol(shapeMode): true,
      Symbol(kCapture): false,
      Symbol(kHeaders): [Object],
      Symbol(kHeadersCount): 30,
      Symbol(kTrailers): null,
      Symbol(kTrailersCount): 0
    },
    aborted: false,
    timeoutCb: null,
    upgradeOrConnect: false,
    parser: null,
    maxHeadersCount: null,
    reusedSocket: false,
    host: 'api.spotify.com',
    protocol: 'https:',
    _redirectable: Writable {
      _events: [Object],
      _writableState: [WritableState],
      _maxListeners: undefined,
      _options: [Object],
      _ended: true,
      _ending: true,
      _redirectCount: 0,
      _redirects: [],
      _requestBodyLength: 0,
      _requestBodyBuffers: [],
      _eventsCount: 3,
      _onNativeResponse: [Function (anonymous)],
      _currentRequest: [Circular *1],
      _currentUrl: 'https://api.spotify.com/v1/tracks?ids=61fnOBpTBUPjyeQVobKJqL,47yLfurzqke5gcdVG9PXYf,5xGm4rLxe7nZWswPc3BU3s,3Jti8kGqr6mPWT304JUTr4,5tpWDyyOr4GDcpNYsn8LMI,2GSIXbSNZRF2mUl4LnoOeD,50DyQQ9sog4azZmF5tSJlK,1RFLkDNFSUKB9n7USEdw3X,7pBHLxLuo0epUw53Wij0Pq,1vZ0MPp1LXfa1AZDCWRhOZ,0nsias9MU5qcRAlfytAXsc,2nlivHG7sBn9C22SBhzuQp,5n6gfU5WOaMazDwejuJW35,0YS5kV6GJT6t5cDc4Vgsgp,5KLcIahbdBJeZ8tHAyYMpN,3gF64oRdu5O5m5Eucx4JY1,4GPLb3A6MbjzlimKcqGJQl,3dZV4HZQwkw8ktt4SsjBJW,3dZV4HZQwkw8ktt4SsjBJW,0lwkzF4dDxLp8HMVSQjpFf,3nQsESv9BOJZSzFCxfpWpB,193jGhmmCTDj8hBThUPnRA,09ttHg3ZNVgDlYBZa1ZBw0,53XLfXbVPTY7lO36pOBvIu,31ZJBAyjI7XWBpIZeMbXXC,784HPjRj1dFr1XfdEnJfI0,7ryc6Dg8IjEtDXSlNC6NrL,2Q7r5HzvtVXD9v4apv95Xn,0uowUdDOAcdicQTNWR6zWa,20Mgn25bgsia8Dn9CLxAXE',
      _timeout: null,
      Symbol(shapeMode): true,
      Symbol(kCapture): false
    },
    Symbol(shapeMode): false,
    Symbol(kCapture): false,
    Symbol(kBytesWritten): 0,
    Symbol(kNeedDrain): false,
    Symbol(corked): 0,
    Symbol(kChunkedBuffer): [],
    Symbol(kChunkedLength): 0,
    Symbol(kSocket): TLSSocket {
      _tlsOptions: [Object],
      _secureEstablished: true,
      _securePending: false,
      _newSessionPending: false,
      _controlReleased: true,
      secureConnecting: false,
      _SNICallback: null,
      servername: 'api.spotify.com',
      alpnProtocol: false,
      authorized: true,
      authorizationError: null,
      encrypted: true,
      _events: [Object: null prototype],
      _eventsCount: 9,
      connecting: false,
      _hadError: false,
      _parent: null,
      _host: 'api.spotify.com',
      _closeAfterHandlingError: false,
      _readableState: [ReadableState],
      _writableState: [WritableState],
      allowHalfOpen: false,
      _maxListeners: undefined,
      _sockname: null,
      _pendingData: null,
      _pendingEncoding: '',
      server: undefined,
      _server: null,
      ssl: [TLSWrap],
      _requestCert: true,
      _rejectUnauthorized: true,
      timeout: 5000,
      parser: null,
      _httpMessage: null,
      autoSelectFamilyAttemptedAddresses: [Array],
      Symbol(alpncallback): null,
      Symbol(res): [TLSWrap],
      Symbol(verified): true,
      Symbol(pendingSession): null,
      Symbol(async_id_symbol): -1,
      Symbol(kHandle): [TLSWrap],
      Symbol(lastWriteQueueSize): 0,
      Symbol(timeout): Timeout {
        _idleTimeout: 5000,
        _idlePrev: [TimersList],
        _idleNext: [TimersList],
        _idleStart: 3568133,
        _onTimeout: [Function: bound ],
        _timerArgs: undefined,
        _repeat: null,
        _destroyed: false,
        Symbol(refed): false,
        Symbol(kHasPrimitive): false,
        Symbol(asyncId): 78335,
        Symbol(triggerId): 78333,
        Symbol(kAsyncContextFrame): undefined
      },
      Symbol(kBuffer): null,
      Symbol(kBufferCb): null,
      Symbol(kBufferGen): null,
      Symbol(shapeMode): true,
      Symbol(kCapture): false,
      Symbol(kSetNoDelay): false,
      Symbol(kSetKeepAlive): true,
      Symbol(kSetKeepAliveInitialDelay): 1,
      Symbol(kBytesRead): 0,
      Symbol(kBytesWritten): 0,
      Symbol(connect-options): [Object]
    },
    Symbol(kOutHeaders): [Object: null prototype] {
      accept: [Array],
      'content-type': [Array],
      authorization: [Array],
      'user-agent': [Array],
      'accept-encoding': [Array],
      host: [Array]
    },
    Symbol(errored): null,
    Symbol(kHighWaterMark): 65536,
    Symbol(kRejectNonStandardBodyWrites): false,
    Symbol(kUniqueHeaders): null
  },
  response: {
    status: 429,
    statusText: 'Too Many Requests',
    headers: Object [AxiosHeaders] {
      'cache-control': 'private, max-age=0',
      'retry-after': '8890',
      'access-control-allow-origin': '*',
      'access-control-allow-headers': 'Accept, App-Platform, Authorization, Content-Type, Origin, Retry-After, Spotify-App-Version, X-Cloud-Trace-Context, client-token, content-access-token',
      'access-control-allow-methods': 'GET, POST, OPTIONS, PUT, DELETE, PATCH',
      'access-control-allow-credentials': 'true',
      'access-control-max-age': '604800',
      'content-length': '17',
      'strict-transport-security': 'max-age=31536000',
      'x-content-type-options': 'nosniff',
      'alt-svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000, h3=":443"; ma=2592000',
      date: 'Wed, 06 May 2026 04:55:52 GMT',
      server: 'envoy',
      via: 'HTTP/2 edgeproxy, 1.1 google'
    },
    config: {
      transitional: [Object],
      adapter: [Array],
      transformRequest: [Array],
      transformResponse: [Array],
      timeout: 0,
      xsrfCookieName: 'XSRF-TOKEN',
      xsrfHeaderName: 'X-XSRF-TOKEN',
      maxContentLength: -1,
      maxBodyLength: -1,
      env: [Object],
      validateStatus: [Function: validateStatus],
      headers: [Object [AxiosHeaders]],
      baseURL: 'https://api.spotify.com/v1',
      method: 'get',
      url: 'https://api.spotify.com/v1/tracks?ids=61fnOBpTBUPjyeQVobKJqL,47yLfurzqke5gcdVG9PXYf,5xGm4rLxe7nZWswPc3BU3s,3Jti8kGqr6mPWT304JUTr4,5tpWDyyOr4GDcpNYsn8LMI,2GSIXbSNZRF2mUl4LnoOeD,50DyQQ9sog4azZmF5tSJlK,1RFLkDNFSUKB9n7USEdw3X,7pBHLxLuo0epUw53Wij0Pq,1vZ0MPp1LXfa1AZDCWRhOZ,0nsias9MU5qcRAlfytAXsc,2nlivHG7sBn9C22SBhzuQp,5n6gfU5WOaMazDwejuJW35,0YS5kV6GJT6t5cDc4Vgsgp,5KLcIahbdBJeZ8tHAyYMpN,3gF64oRdu5O5m5Eucx4JY1,4GPLb3A6MbjzlimKcqGJQl,3dZV4HZQwkw8ktt4SsjBJW,3dZV4HZQwkw8ktt4SsjBJW,0lwkzF4dDxLp8HMVSQjpFf,3nQsESv9BOJZSzFCxfpWpB,193jGhmmCTDj8hBThUPnRA,09ttHg3ZNVgDlYBZa1ZBw0,53XLfXbVPTY7lO36pOBvIu,31ZJBAyjI7XWBpIZeMbXXC,784HPjRj1dFr1XfdEnJfI0,7ryc6Dg8IjEtDXSlNC6NrL,2Q7r5HzvtVXD9v4apv95Xn,0uowUdDOAcdicQTNWR6zWa,20Mgn25bgsia8Dn9CLxAXE',
      allowAbsoluteUrls: true,
      data: undefined
    },
    request: <ref *1> ClientRequest {
      _events: [Object: null prototype],
      _eventsCount: 7,
      _maxListeners: undefined,
      outputData: [],
      outputSize: 0,
      writable: true,
      destroyed: true,
      _last: true,
      chunkedEncoding: false,
      shouldKeepAlive: true,
      maxRequestsOnConnectionReached: false,
      _defaultKeepAlive: true,
      useChunkedEncodingByDefault: false,
      sendDate: false,
      _removedConnection: false,
      _removedContLen: false,
      _removedTE: false,
      strictContentLength: false,
      _contentLength: 0,
      _hasBody: true,
      _trailer: '',
      finished: true,
      _headerSent: true,
      _closed: true,
      _header: 'GET /v1/tracks?ids=61fnOBpTBUPjyeQVobKJqL,47yLfurzqke5gcdVG9PXYf,5xGm4rLxe7nZWswPc3BU3s,3Jti8kGqr6mPWT304JUTr4,5tpWDyyOr4GDcpNYsn8LMI,2GSIXbSNZRF2mUl4LnoOeD,50DyQQ9sog4azZmF5tSJlK,1RFLkDNFSUKB9n7USEdw3X,7pBHLxLuo0epUw53Wij0Pq,1vZ0MPp1LXfa1AZDCWRhOZ,0nsias9MU5qcRAlfytAXsc,2nlivHG7sBn9C22SBhzuQp,5n6gfU5WOaMazDwejuJW35,0YS5kV6GJT6t5cDc4Vgsgp,5KLcIahbdBJeZ8tHAyYMpN,3gF64oRdu5O5m5Eucx4JY1,4GPLb3A6MbjzlimKcqGJQl,3dZV4HZQwkw8ktt4SsjBJW,3dZV4HZQwkw8ktt4SsjBJW,0lwkzF4dDxLp8HMVSQjpFf,3nQsESv9BOJZSzFCxfpWpB,193jGhmmCTDj8hBThUPnRA,09ttHg3ZNVgDlYBZa1ZBw0,53XLfXbVPTY7lO36pOBvIu,31ZJBAyjI7XWBpIZeMbXXC,784HPjRj1dFr1XfdEnJfI0,7ryc6Dg8IjEtDXSlNC6NrL,2Q7r5HzvtVXD9v4apv95Xn,0uowUdDOAcdicQTNWR6zWa,20Mgn25bgsia8Dn9CLxAXE HTTP/1.1\r\n' +
        'Accept: application/json, text/plain, */*\r\n' +
        'Content-Type: application/json\r\n' +
        'Authorization: Bearer BQCtxDjO_lNRr3tbbhM5hIDCil4f2GgWtJjmVNJLy9_0WR5VXiB8uuiaKDGTsYjRD8QDUi6ZF1DRxdJGFkSVknfTZObV-77RATn1NI8RylOb0zhhup40_bgp0JdVzAxhdBOKSJLvtKrv4QLpmi_gle_f0YZ7iZIY_GPabBaUbAwYWqjO4tBdmgxfOJ-tDNfXMxX1gN9EQZv3BFJ__K4N0ccPZv_5RY1q-N5EWxcLKgo8GL_W097e8SHWJ_lyMODSdsxn-6EMpSqCTikmyOG8_AjUuGmwWKSXEOKNb3fN7rAdb6iUASZGNNrh7D8\r\n' +
        'User-Agent: axios/1.13.2\r\n' +
        'Accept-Encoding: gzip, compress, deflate, br\r\n' +
        'Host: api.spotify.com\r\n' +
        'Connection: keep-alive\r\n' +
        '\r\n',
      _keepAliveTimeout: 0,
      _onPendingData: [Function: nop],
      agent: [Agent],
      socketPath: undefined,
      method: 'GET',
      maxHeaderSize: undefined,
      insecureHTTPParser: undefined,
      joinDuplicateHeaders: undefined,
      path: '/v1/tracks?ids=61fnOBpTBUPjyeQVobKJqL,47yLfurzqke5gcdVG9PXYf,5xGm4rLxe7nZWswPc3BU3s,3Jti8kGqr6mPWT304JUTr4,5tpWDyyOr4GDcpNYsn8LMI,2GSIXbSNZRF2mUl4LnoOeD,50DyQQ9sog4azZmF5tSJlK,1RFLkDNFSUKB9n7USEdw3X,7pBHLxLuo0epUw53Wij0Pq,1vZ0MPp1LXfa1AZDCWRhOZ,0nsias9MU5qcRAlfytAXsc,2nlivHG7sBn9C22SBhzuQp,5n6gfU5WOaMazDwejuJW35,0YS5kV6GJT6t5cDc4Vgsgp,5KLcIahbdBJeZ8tHAyYMpN,3gF64oRdu5O5m5Eucx4JY1,4GPLb3A6MbjzlimKcqGJQl,3dZV4HZQwkw8ktt4SsjBJW,3dZV4HZQwkw8ktt4SsjBJW,0lwkzF4dDxLp8HMVSQjpFf,3nQsESv9BOJZSzFCxfpWpB,193jGhmmCTDj8hBThUPnRA,09ttHg3ZNVgDlYBZa1ZBw0,53XLfXbVPTY7lO36pOBvIu,31ZJBAyjI7XWBpIZeMbXXC,784HPjRj1dFr1XfdEnJfI0,7ryc6Dg8IjEtDXSlNC6NrL,2Q7r5HzvtVXD9v4apv95Xn,0uowUdDOAcdicQTNWR6zWa,20Mgn25bgsia8Dn9CLxAXE',
      _ended: true,
      res: [IncomingMessage],
      aborted: false,
      timeoutCb: null,
      upgradeOrConnect: false,
      parser: null,
      maxHeadersCount: null,
      reusedSocket: false,
      host: 'api.spotify.com',
      protocol: 'https:',
      _redirectable: [Writable],
      Symbol(shapeMode): false,
      Symbol(kCapture): false,
      Symbol(kBytesWritten): 0,
      Symbol(kNeedDrain): false,
      Symbol(corked): 0,
      Symbol(kChunkedBuffer): [],
      Symbol(kChunkedLength): 0,
      Symbol(kSocket): [TLSSocket],
      Symbol(kOutHeaders): [Object: null prototype],
      Symbol(errored): null,
      Symbol(kHighWaterMark): 65536,
      Symbol(kRejectNonStandardBodyWrites): false,
      Symbol(kUniqueHeaders): null
    },
    data: 'Too many requests'
  },
  status: 429
}
[error] [5/6/2026, 4:55:53 AM] Retrying crashed promise, 2/10, retrying in 30 seconds...

Also tried this script to convert into the other data format, but running into the same issue

Do we know what the rate limit cooldown is for this API? seems like some are having luck with spacing out imports every 24h?

Regarding the size, I've managed to successfully import one extended hist file with ~6200 entries yeterday, but no success since then

[Rekkertt]

I'm getting the same issue. I tried downgrading to 1.17.0, but I'm getting these logs after initiating and extended history import:

POST /import/full-privacy 200 542.012 ms - 25
GET /imports 200 3.430 ms - 852
[error] [5/6/2026, 4:55:22 AM] Retrying crashed promise, 9/10, retrying in 30 seconds...
[error] [5/6/2026, 4:55:23 AM] Retrying crashed promise, 1/10, retrying in 30 seconds...
GET /imports 304 3.610 ms - -
GET /imports 304 3.345 ms - -
GET /imports 304 3.346 ms - -
GET /imports 304 3.194 ms - -
GET /imports 304 3.281 ms - -
GET /imports 304 3.298 ms - -
GET /imports 304 3.358 ms - -
GET /imports 304 3.690 ms - -
GET /imports 304 3.172 ms - -
GET /imports 304 3.755 ms - -
GET /imports 304 3.312 ms - -
GET /imports 304 3.309 ms - -
GET /imports 304 3.281 ms - -
GET /imports 304 3.324 ms - -
GET /imports 304 3.326 ms - -
[error] [5/6/2026, 4:55:52 AM] Retrying crashed promise, 10/10
[info] [5/6/2026, 4:55:52 AM] Response of failed request Too many requests
[info] [5/6/2026, 4:55:52 AM] There appears to be issues with either your internet connection or Spotify
[error] [5/6/2026, 4:55:52 AM] [consistencypls]: Error during refresh el [AxiosError]: Request failed with status code 429
    at eY (/app/apps/server/build/index.js:11:913238)
    at IncomingMessage.<anonymous> (/app/apps/server/build/index.js:13:11787)
    at IncomingMessage.emit (node:events:520:35)
    at endReadableNT (node:internal/streams/readable:1701:12)
    at process.processTicksAndRejections (node:internal/process/task_queues:89:21)
    at tQ.request (/app/apps/server/build/index.js:13:24288)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async Object.execQueue (/app/apps/server/build/index.js:32:62884) {
  code: 'ERR_BAD_REQUEST',
  config: {
    transitional: {
      silentJSONParsing: true,
      forcedJSONParsing: true,
      clarifyTimeoutError: false
    },
    adapter: [ 'xhr', 'http', 'fetch' ],
    transformRequest: [ [Function (anonymous)] ],
    transformResponse: [ [Function (anonymous)] ],
    timeout: 0,
    xsrfCookieName: 'XSRF-TOKEN',
    xsrfHeaderName: 'X-XSRF-TOKEN',
    maxContentLength: -1,
    maxBodyLength: -1,
    env: { FormData: [Function], Blob: [class Blob] },
    validateStatus: [Function: validateStatus],
    headers: Object [AxiosHeaders] {
      Accept: 'application/json, text/plain, */*',
      'Content-Type': 'application/json',
      Authorization: 'Bearer BQCtxDjO_lNRr3tbbhM5hIDCil4f2GgWtJjmVNJLy9_0WR5VXiB8uuiaKDGTsYjRD8QDUi6ZF1DRxdJGFkSVknfTZObV-77RATn1NI8RylOb0zhhup40_bgp0JdVzAxhdBOKSJLvtKrv4QLpmi_gle_f0YZ7iZIY_GPabBaUbAwYWqjO4tBdmgxfOJ-tDNfXMxX1gN9EQZv3BFJ__K4N0ccPZv_5RY1q-N5EWxcLKgo8GL_W097e8SHWJ_lyMODSdsxn-6EMpSqCTikmyOG8_AjUuGmwWKSXEOKNb3fN7rAdb6iUASZGNNrh7D8',
      'User-Agent': 'axios/1.13.2',
      'Accept-Encoding': 'gzip, compress, deflate, br'
    },
    baseURL: 'https://api.spotify.com/v1',
    method: 'get',
    url: 'https://api.spotify.com/v1/tracks?ids=61fnOBpTBUPjyeQVobKJqL,47yLfurzqke5gcdVG9PXYf,5xGm4rLxe7nZWswPc3BU3s,3Jti8kGqr6mPWT304JUTr4,5tpWDyyOr4GDcpNYsn8LMI,2GSIXbSNZRF2mUl4LnoOeD,50DyQQ9sog4azZmF5tSJlK,1RFLkDNFSUKB9n7USEdw3X,7pBHLxLuo0epUw53Wij0Pq,1vZ0MPp1LXfa1AZDCWRhOZ,0nsias9MU5qcRAlfytAXsc,2nlivHG7sBn9C22SBhzuQp,5n6gfU5WOaMazDwejuJW35,0YS5kV6GJT6t5cDc4Vgsgp,5KLcIahbdBJeZ8tHAyYMpN,3gF64oRdu5O5m5Eucx4JY1,4GPLb3A6MbjzlimKcqGJQl,3dZV4HZQwkw8ktt4SsjBJW,3dZV4HZQwkw8ktt4SsjBJW,0lwkzF4dDxLp8HMVSQjpFf,3nQsESv9BOJZSzFCxfpWpB,193jGhmmCTDj8hBThUPnRA,09ttHg3ZNVgDlYBZa1ZBw0,53XLfXbVPTY7lO36pOBvIu,31ZJBAyjI7XWBpIZeMbXXC,784HPjRj1dFr1XfdEnJfI0,7ryc6Dg8IjEtDXSlNC6NrL,2Q7r5HzvtVXD9v4apv95Xn,0uowUdDOAcdicQTNWR6zWa,20Mgn25bgsia8Dn9CLxAXE',
    allowAbsoluteUrls: true,
    data: undefined
  },
  request: <ref *1> ClientRequest {
    _events: [Object: null prototype] {
      abort: [Function (anonymous)],
      aborted: [Function (anonymous)],
      connect: [Function (anonymous)],
      error: [Function (anonymous)],
      socket: [Function (anonymous)],
      timeout: [Function (anonymous)],
      finish: [Function: requestOnFinish]
    },
    _eventsCount: 7,
    _maxListeners: undefined,
    outputData: [],
    outputSize: 0,
    writable: true,
    destroyed: true,
    _last: true,
    chunkedEncoding: false,
    shouldKeepAlive: true,
    maxRequestsOnConnectionReached: false,
    _defaultKeepAlive: true,
    useChunkedEncodingByDefault: false,
    sendDate: false,
    _removedConnection: false,
    _removedContLen: false,
    _removedTE: false,
    strictContentLength: false,
    _contentLength: 0,
    _hasBody: true,
    _trailer: '',
    finished: true,
    _headerSent: true,
    _closed: true,
    _header: 'GET /v1/tracks?ids=61fnOBpTBUPjyeQVobKJqL,47yLfurzqke5gcdVG9PXYf,5xGm4rLxe7nZWswPc3BU3s,3Jti8kGqr6mPWT304JUTr4,5tpWDyyOr4GDcpNYsn8LMI,2GSIXbSNZRF2mUl4LnoOeD,50DyQQ9sog4azZmF5tSJlK,1RFLkDNFSUKB9n7USEdw3X,7pBHLxLuo0epUw53Wij0Pq,1vZ0MPp1LXfa1AZDCWRhOZ,0nsias9MU5qcRAlfytAXsc,2nlivHG7sBn9C22SBhzuQp,5n6gfU5WOaMazDwejuJW35,0YS5kV6GJT6t5cDc4Vgsgp,5KLcIahbdBJeZ8tHAyYMpN,3gF64oRdu5O5m5Eucx4JY1,4GPLb3A6MbjzlimKcqGJQl,3dZV4HZQwkw8ktt4SsjBJW,3dZV4HZQwkw8ktt4SsjBJW,0lwkzF4dDxLp8HMVSQjpFf,3nQsESv9BOJZSzFCxfpWpB,193jGhmmCTDj8hBThUPnRA,09ttHg3ZNVgDlYBZa1ZBw0,53XLfXbVPTY7lO36pOBvIu,31ZJBAyjI7XWBpIZeMbXXC,784HPjRj1dFr1XfdEnJfI0,7ryc6Dg8IjEtDXSlNC6NrL,2Q7r5HzvtVXD9v4apv95Xn,0uowUdDOAcdicQTNWR6zWa,20Mgn25bgsia8Dn9CLxAXE HTTP/1.1\r\n' +
      'Accept: application/json, text/plain, */*\r\n' +
      'Content-Type: application/json\r\n' +
      'Authorization: Bearer BQCtxDjO_lNRr3tbbhM5hIDCil4f2GgWtJjmVNJLy9_0WR5VXiB8uuiaKDGTsYjRD8QDUi6ZF1DRxdJGFkSVknfTZObV-77RATn1NI8RylOb0zhhup40_bgp0JdVzAxhdBOKSJLvtKrv4QLpmi_gle_f0YZ7iZIY_GPabBaUbAwYWqjO4tBdmgxfOJ-tDNfXMxX1gN9EQZv3BFJ__K4N0ccPZv_5RY1q-N5EWxcLKgo8GL_W097e8SHWJ_lyMODSdsxn-6EMpSqCTikmyOG8_AjUuGmwWKSXEOKNb3fN7rAdb6iUASZGNNrh7D8\r\n' +
      'User-Agent: axios/1.13.2\r\n' +
      'Accept-Encoding: gzip, compress, deflate, br\r\n' +
      'Host: api.spotify.com\r\n' +
      'Connection: keep-alive\r\n' +
      '\r\n',
    _keepAliveTimeout: 0,
    _onPendingData: [Function: nop],
    agent: Agent {
      _events: [Object: null prototype],
      _eventsCount: 2,
      _maxListeners: undefined,
      options: [Object: null prototype],
      defaultPort: 443,
      protocol: 'https:',
      requests: [Object: null prototype] {},
      sockets: [Object: null prototype] {},
      freeSockets: [Object: null prototype],
      keepAliveMsecs: 1000,
      keepAlive: true,
      maxSockets: Infinity,
      maxFreeSockets: 256,
      scheduling: 'lifo',
      maxTotalSockets: Infinity,
      totalSocketCount: 1,
      agentKeepAliveTimeoutBuffer: 1000,
      maxCachedSessions: 100,
      _sessionCache: [Object],
      Symbol(shapeMode): false,
      Symbol(kCapture): false
    },
    socketPath: undefined,
    method: 'GET',
    maxHeaderSize: undefined,
    insecureHTTPParser: undefined,
    joinDuplicateHeaders: undefined,
    path: '/v1/tracks?ids=61fnOBpTBUPjyeQVobKJqL,47yLfurzqke5gcdVG9PXYf,5xGm4rLxe7nZWswPc3BU3s,3Jti8kGqr6mPWT304JUTr4,5tpWDyyOr4GDcpNYsn8LMI,2GSIXbSNZRF2mUl4LnoOeD,50DyQQ9sog4azZmF5tSJlK,1RFLkDNFSUKB9n7USEdw3X,7pBHLxLuo0epUw53Wij0Pq,1vZ0MPp1LXfa1AZDCWRhOZ,0nsias9MU5qcRAlfytAXsc,2nlivHG7sBn9C22SBhzuQp,5n6gfU5WOaMazDwejuJW35,0YS5kV6GJT6t5cDc4Vgsgp,5KLcIahbdBJeZ8tHAyYMpN,3gF64oRdu5O5m5Eucx4JY1,4GPLb3A6MbjzlimKcqGJQl,3dZV4HZQwkw8ktt4SsjBJW,3dZV4HZQwkw8ktt4SsjBJW,0lwkzF4dDxLp8HMVSQjpFf,3nQsESv9BOJZSzFCxfpWpB,193jGhmmCTDj8hBThUPnRA,09ttHg3ZNVgDlYBZa1ZBw0,53XLfXbVPTY7lO36pOBvIu,31ZJBAyjI7XWBpIZeMbXXC,784HPjRj1dFr1XfdEnJfI0,7ryc6Dg8IjEtDXSlNC6NrL,2Q7r5HzvtVXD9v4apv95Xn,0uowUdDOAcdicQTNWR6zWa,20Mgn25bgsia8Dn9CLxAXE',
    _ended: true,
    res: IncomingMessage {
      _events: [Object],
      _readableState: [ReadableState],
      _maxListeners: undefined,
      socket: null,
      httpVersionMajor: 1,
      httpVersionMinor: 1,
      httpVersion: '1.1',
      complete: true,
      rawHeaders: [Array],
      rawTrailers: [],
      joinDuplicateHeaders: undefined,
      aborted: false,
      upgrade: false,
      url: '',
      method: null,
      statusCode: 429,
      statusMessage: 'Too Many Requests',
      client: [TLSSocket],
      _consuming: false,
      _dumped: false,
      req: [Circular *1],
      _eventsCount: 4,
      responseUrl: 'https://api.spotify.com/v1/tracks?ids=61fnOBpTBUPjyeQVobKJqL,47yLfurzqke5gcdVG9PXYf,5xGm4rLxe7nZWswPc3BU3s,3Jti8kGqr6mPWT304JUTr4,5tpWDyyOr4GDcpNYsn8LMI,2GSIXbSNZRF2mUl4LnoOeD,50DyQQ9sog4azZmF5tSJlK,1RFLkDNFSUKB9n7USEdw3X,7pBHLxLuo0epUw53Wij0Pq,1vZ0MPp1LXfa1AZDCWRhOZ,0nsias9MU5qcRAlfytAXsc,2nlivHG7sBn9C22SBhzuQp,5n6gfU5WOaMazDwejuJW35,0YS5kV6GJT6t5cDc4Vgsgp,5KLcIahbdBJeZ8tHAyYMpN,3gF64oRdu5O5m5Eucx4JY1,4GPLb3A6MbjzlimKcqGJQl,3dZV4HZQwkw8ktt4SsjBJW,3dZV4HZQwkw8ktt4SsjBJW,0lwkzF4dDxLp8HMVSQjpFf,3nQsESv9BOJZSzFCxfpWpB,193jGhmmCTDj8hBThUPnRA,09ttHg3ZNVgDlYBZa1ZBw0,53XLfXbVPTY7lO36pOBvIu,31ZJBAyjI7XWBpIZeMbXXC,784HPjRj1dFr1XfdEnJfI0,7ryc6Dg8IjEtDXSlNC6NrL,2Q7r5HzvtVXD9v4apv95Xn,0uowUdDOAcdicQTNWR6zWa,20Mgn25bgsia8Dn9CLxAXE',
      redirects: [],
      Symbol(shapeMode): true,
      Symbol(kCapture): false,
      Symbol(kHeaders): [Object],
      Symbol(kHeadersCount): 30,
      Symbol(kTrailers): null,
      Symbol(kTrailersCount): 0
    },
    aborted: false,
    timeoutCb: null,
    upgradeOrConnect: false,
    parser: null,
    maxHeadersCount: null,
    reusedSocket: false,
    host: 'api.spotify.com',
    protocol: 'https:',
    _redirectable: Writable {
      _events: [Object],
      _writableState: [WritableState],
      _maxListeners: undefined,
      _options: [Object],
      _ended: true,
      _ending: true,
      _redirectCount: 0,
      _redirects: [],
      _requestBodyLength: 0,
      _requestBodyBuffers: [],
      _eventsCount: 3,
      _onNativeResponse: [Function (anonymous)],
      _currentRequest: [Circular *1],
      _currentUrl: 'https://api.spotify.com/v1/tracks?ids=61fnOBpTBUPjyeQVobKJqL,47yLfurzqke5gcdVG9PXYf,5xGm4rLxe7nZWswPc3BU3s,3Jti8kGqr6mPWT304JUTr4,5tpWDyyOr4GDcpNYsn8LMI,2GSIXbSNZRF2mUl4LnoOeD,50DyQQ9sog4azZmF5tSJlK,1RFLkDNFSUKB9n7USEdw3X,7pBHLxLuo0epUw53Wij0Pq,1vZ0MPp1LXfa1AZDCWRhOZ,0nsias9MU5qcRAlfytAXsc,2nlivHG7sBn9C22SBhzuQp,5n6gfU5WOaMazDwejuJW35,0YS5kV6GJT6t5cDc4Vgsgp,5KLcIahbdBJeZ8tHAyYMpN,3gF64oRdu5O5m5Eucx4JY1,4GPLb3A6MbjzlimKcqGJQl,3dZV4HZQwkw8ktt4SsjBJW,3dZV4HZQwkw8ktt4SsjBJW,0lwkzF4dDxLp8HMVSQjpFf,3nQsESv9BOJZSzFCxfpWpB,193jGhmmCTDj8hBThUPnRA,09ttHg3ZNVgDlYBZa1ZBw0,53XLfXbVPTY7lO36pOBvIu,31ZJBAyjI7XWBpIZeMbXXC,784HPjRj1dFr1XfdEnJfI0,7ryc6Dg8IjEtDXSlNC6NrL,2Q7r5HzvtVXD9v4apv95Xn,0uowUdDOAcdicQTNWR6zWa,20Mgn25bgsia8Dn9CLxAXE',
      _timeout: null,
      Symbol(shapeMode): true,
      Symbol(kCapture): false
    },
    Symbol(shapeMode): false,
    Symbol(kCapture): false,
    Symbol(kBytesWritten): 0,
    Symbol(kNeedDrain): false,
    Symbol(corked): 0,
    Symbol(kChunkedBuffer): [],
    Symbol(kChunkedLength): 0,
    Symbol(kSocket): TLSSocket {
      _tlsOptions: [Object],
      _secureEstablished: true,
      _securePending: false,
      _newSessionPending: false,
      _controlReleased: true,
      secureConnecting: false,
      _SNICallback: null,
      servername: 'api.spotify.com',
      alpnProtocol: false,
      authorized: true,
      authorizationError: null,
      encrypted: true,
      _events: [Object: null prototype],
      _eventsCount: 9,
      connecting: false,
      _hadError: false,
      _parent: null,
      _host: 'api.spotify.com',
      _closeAfterHandlingError: false,
      _readableState: [ReadableState],
      _writableState: [WritableState],
      allowHalfOpen: false,
      _maxListeners: undefined,
      _sockname: null,
      _pendingData: null,
      _pendingEncoding: '',
      server: undefined,
      _server: null,
      ssl: [TLSWrap],
      _requestCert: true,
      _rejectUnauthorized: true,
      timeout: 5000,
      parser: null,
      _httpMessage: null,
      autoSelectFamilyAttemptedAddresses: [Array],
      Symbol(alpncallback): null,
      Symbol(res): [TLSWrap],
      Symbol(verified): true,
      Symbol(pendingSession): null,
      Symbol(async_id_symbol): -1,
      Symbol(kHandle): [TLSWrap],
      Symbol(lastWriteQueueSize): 0,
      Symbol(timeout): Timeout {
        _idleTimeout: 5000,
        _idlePrev: [TimersList],
        _idleNext: [TimersList],
        _idleStart: 3568133,
        _onTimeout: [Function: bound ],
        _timerArgs: undefined,
        _repeat: null,
        _destroyed: false,
        Symbol(refed): false,
        Symbol(kHasPrimitive): false,
        Symbol(asyncId): 78335,
        Symbol(triggerId): 78333,
        Symbol(kAsyncContextFrame): undefined
      },
      Symbol(kBuffer): null,
      Symbol(kBufferCb): null,
      Symbol(kBufferGen): null,
      Symbol(shapeMode): true,
      Symbol(kCapture): false,
      Symbol(kSetNoDelay): false,
      Symbol(kSetKeepAlive): true,
      Symbol(kSetKeepAliveInitialDelay): 1,
      Symbol(kBytesRead): 0,
      Symbol(kBytesWritten): 0,
      Symbol(connect-options): [Object]
    },
    Symbol(kOutHeaders): [Object: null prototype] {
      accept: [Array],
      'content-type': [Array],
      authorization: [Array],
      'user-agent': [Array],
      'accept-encoding': [Array],
      host: [Array]
    },
    Symbol(errored): null,
    Symbol(kHighWaterMark): 65536,
    Symbol(kRejectNonStandardBodyWrites): false,
    Symbol(kUniqueHeaders): null
  },
  response: {
    status: 429,
    statusText: 'Too Many Requests',
    headers: Object [AxiosHeaders] {
      'cache-control': 'private, max-age=0',
      'retry-after': '8890',
      'access-control-allow-origin': '*',
      'access-control-allow-headers': 'Accept, App-Platform, Authorization, Content-Type, Origin, Retry-After, Spotify-App-Version, X-Cloud-Trace-Context, client-token, content-access-token',
      'access-control-allow-methods': 'GET, POST, OPTIONS, PUT, DELETE, PATCH',
      'access-control-allow-credentials': 'true',
      'access-control-max-age': '604800',
      'content-length': '17',
      'strict-transport-security': 'max-age=31536000',
      'x-content-type-options': 'nosniff',
      'alt-svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000, h3=":443"; ma=2592000',
      date: 'Wed, 06 May 2026 04:55:52 GMT',
      server: 'envoy',
      via: 'HTTP/2 edgeproxy, 1.1 google'
    },
    config: {
      transitional: [Object],
      adapter: [Array],
      transformRequest: [Array],
      transformResponse: [Array],
      timeout: 0,
      xsrfCookieName: 'XSRF-TOKEN',
      xsrfHeaderName: 'X-XSRF-TOKEN',
      maxContentLength: -1,
      maxBodyLength: -1,
      env: [Object],
      validateStatus: [Function: validateStatus],
      headers: [Object [AxiosHeaders]],
      baseURL: 'https://api.spotify.com/v1',
      method: 'get',
      url: 'https://api.spotify.com/v1/tracks?ids=61fnOBpTBUPjyeQVobKJqL,47yLfurzqke5gcdVG9PXYf,5xGm4rLxe7nZWswPc3BU3s,3Jti8kGqr6mPWT304JUTr4,5tpWDyyOr4GDcpNYsn8LMI,2GSIXbSNZRF2mUl4LnoOeD,50DyQQ9sog4azZmF5tSJlK,1RFLkDNFSUKB9n7USEdw3X,7pBHLxLuo0epUw53Wij0Pq,1vZ0MPp1LXfa1AZDCWRhOZ,0nsias9MU5qcRAlfytAXsc,2nlivHG7sBn9C22SBhzuQp,5n6gfU5WOaMazDwejuJW35,0YS5kV6GJT6t5cDc4Vgsgp,5KLcIahbdBJeZ8tHAyYMpN,3gF64oRdu5O5m5Eucx4JY1,4GPLb3A6MbjzlimKcqGJQl,3dZV4HZQwkw8ktt4SsjBJW,3dZV4HZQwkw8ktt4SsjBJW,0lwkzF4dDxLp8HMVSQjpFf,3nQsESv9BOJZSzFCxfpWpB,193jGhmmCTDj8hBThUPnRA,09ttHg3ZNVgDlYBZa1ZBw0,53XLfXbVPTY7lO36pOBvIu,31ZJBAyjI7XWBpIZeMbXXC,784HPjRj1dFr1XfdEnJfI0,7ryc6Dg8IjEtDXSlNC6NrL,2Q7r5HzvtVXD9v4apv95Xn,0uowUdDOAcdicQTNWR6zWa,20Mgn25bgsia8Dn9CLxAXE',
      allowAbsoluteUrls: true,
      data: undefined
    },
    request: <ref *1> ClientRequest {
      _events: [Object: null prototype],
      _eventsCount: 7,
      _maxListeners: undefined,
      outputData: [],
      outputSize: 0,
      writable: true,
      destroyed: true,
      _last: true,
      chunkedEncoding: false,
      shouldKeepAlive: true,
      maxRequestsOnConnectionReached: false,
      _defaultKeepAlive: true,
      useChunkedEncodingByDefault: false,
      sendDate: false,
      _removedConnection: false,
      _removedContLen: false,
      _removedTE: false,
      strictContentLength: false,
      _contentLength: 0,
      _hasBody: true,
      _trailer: '',
      finished: true,
      _headerSent: true,
      _closed: true,
      _header: 'GET /v1/tracks?ids=61fnOBpTBUPjyeQVobKJqL,47yLfurzqke5gcdVG9PXYf,5xGm4rLxe7nZWswPc3BU3s,3Jti8kGqr6mPWT304JUTr4,5tpWDyyOr4GDcpNYsn8LMI,2GSIXbSNZRF2mUl4LnoOeD,50DyQQ9sog4azZmF5tSJlK,1RFLkDNFSUKB9n7USEdw3X,7pBHLxLuo0epUw53Wij0Pq,1vZ0MPp1LXfa1AZDCWRhOZ,0nsias9MU5qcRAlfytAXsc,2nlivHG7sBn9C22SBhzuQp,5n6gfU5WOaMazDwejuJW35,0YS5kV6GJT6t5cDc4Vgsgp,5KLcIahbdBJeZ8tHAyYMpN,3gF64oRdu5O5m5Eucx4JY1,4GPLb3A6MbjzlimKcqGJQl,3dZV4HZQwkw8ktt4SsjBJW,3dZV4HZQwkw8ktt4SsjBJW,0lwkzF4dDxLp8HMVSQjpFf,3nQsESv9BOJZSzFCxfpWpB,193jGhmmCTDj8hBThUPnRA,09ttHg3ZNVgDlYBZa1ZBw0,53XLfXbVPTY7lO36pOBvIu,31ZJBAyjI7XWBpIZeMbXXC,784HPjRj1dFr1XfdEnJfI0,7ryc6Dg8IjEtDXSlNC6NrL,2Q7r5HzvtVXD9v4apv95Xn,0uowUdDOAcdicQTNWR6zWa,20Mgn25bgsia8Dn9CLxAXE HTTP/1.1\r\n' +
        'Accept: application/json, text/plain, */*\r\n' +
        'Content-Type: application/json\r\n' +
        'Authorization: Bearer BQCtxDjO_lNRr3tbbhM5hIDCil4f2GgWtJjmVNJLy9_0WR5VXiB8uuiaKDGTsYjRD8QDUi6ZF1DRxdJGFkSVknfTZObV-77RATn1NI8RylOb0zhhup40_bgp0JdVzAxhdBOKSJLvtKrv4QLpmi_gle_f0YZ7iZIY_GPabBaUbAwYWqjO4tBdmgxfOJ-tDNfXMxX1gN9EQZv3BFJ__K4N0ccPZv_5RY1q-N5EWxcLKgo8GL_W097e8SHWJ_lyMODSdsxn-6EMpSqCTikmyOG8_AjUuGmwWKSXEOKNb3fN7rAdb6iUASZGNNrh7D8\r\n' +
        'User-Agent: axios/1.13.2\r\n' +
        'Accept-Encoding: gzip, compress, deflate, br\r\n' +
        'Host: api.spotify.com\r\n' +
        'Connection: keep-alive\r\n' +
        '\r\n',
      _keepAliveTimeout: 0,
      _onPendingData: [Function: nop],
      agent: [Agent],
      socketPath: undefined,
      method: 'GET',
      maxHeaderSize: undefined,
      insecureHTTPParser: undefined,
      joinDuplicateHeaders: undefined,
      path: '/v1/tracks?ids=61fnOBpTBUPjyeQVobKJqL,47yLfurzqke5gcdVG9PXYf,5xGm4rLxe7nZWswPc3BU3s,3Jti8kGqr6mPWT304JUTr4,5tpWDyyOr4GDcpNYsn8LMI,2GSIXbSNZRF2mUl4LnoOeD,50DyQQ9sog4azZmF5tSJlK,1RFLkDNFSUKB9n7USEdw3X,7pBHLxLuo0epUw53Wij0Pq,1vZ0MPp1LXfa1AZDCWRhOZ,0nsias9MU5qcRAlfytAXsc,2nlivHG7sBn9C22SBhzuQp,5n6gfU5WOaMazDwejuJW35,0YS5kV6GJT6t5cDc4Vgsgp,5KLcIahbdBJeZ8tHAyYMpN,3gF64oRdu5O5m5Eucx4JY1,4GPLb3A6MbjzlimKcqGJQl,3dZV4HZQwkw8ktt4SsjBJW,3dZV4HZQwkw8ktt4SsjBJW,0lwkzF4dDxLp8HMVSQjpFf,3nQsESv9BOJZSzFCxfpWpB,193jGhmmCTDj8hBThUPnRA,09ttHg3ZNVgDlYBZa1ZBw0,53XLfXbVPTY7lO36pOBvIu,31ZJBAyjI7XWBpIZeMbXXC,784HPjRj1dFr1XfdEnJfI0,7ryc6Dg8IjEtDXSlNC6NrL,2Q7r5HzvtVXD9v4apv95Xn,0uowUdDOAcdicQTNWR6zWa,20Mgn25bgsia8Dn9CLxAXE',
      _ended: true,
      res: [IncomingMessage],
      aborted: false,
      timeoutCb: null,
      upgradeOrConnect: false,
      parser: null,
      maxHeadersCount: null,
      reusedSocket: false,
      host: 'api.spotify.com',
      protocol: 'https:',
      _redirectable: [Writable],
      Symbol(shapeMode): false,
      Symbol(kCapture): false,
      Symbol(kBytesWritten): 0,
      Symbol(kNeedDrain): false,
      Symbol(corked): 0,
      Symbol(kChunkedBuffer): [],
      Symbol(kChunkedLength): 0,
      Symbol(kSocket): [TLSSocket],
      Symbol(kOutHeaders): [Object: null prototype],
      Symbol(errored): null,
      Symbol(kHighWaterMark): 65536,
      Symbol(kRejectNonStandardBodyWrites): false,
      Symbol(kUniqueHeaders): null
    },
    data: 'Too many requests'
  },
  status: 429
}
[error] [5/6/2026, 4:55:53 AM] Retrying crashed promise, 2/10, retrying in 30 seconds...

Also tried this script to convert into the other data format, but running into the same issue

Do we know what the rate limit cooldown is for this API? seems like some are having luck with spacing out imports every 24h?

Regarding the size, I've managed to successfully import one extended hist file with ~6200 entries yeterday, but no success since then

You hit the API limit (429).
I have seen this before when trying to import multiple files.
Again I was able to import a file with 12k entries today with no problem after the 24 hours.
At this rate, only 14 days left until I have every year imported... :(

[BlakeJC94]

@Yooooomi I noticed this in the response log I posted above:

  ...
  response: {
    status: 429,
    statusText: 'Too Many Requests',
    headers: Object [AxiosHeaders] {
      'cache-control': 'private, max-age=0',
      'retry-after': '8890',
      'access-control-allow-origin': '*',
      ...

Should we consider updating the importing code to utilize the retry-after field?

Imports would still be rate limited and take just as long, but this could directly solve the issue of the "broken promises" that result in this issue?

Happy to have a crack at a PR if you're open to the idea 😁