TypeError: first argument must be an iterable of pandas objects

Dung Do Tien May 30 2021 306

I have a big Dataframe, I want to load a CSV file and I try to split that and after execute run concat() method. See code below:

df2 = pd.read_csv('et_users.csv', header=None, names=names2, chunksize=100000)
for chunk in df2:
    chunk['ID'] = chunk.ID.map(rep.set_index('member_id')['panel_mm_id'])

df2 = pd.concat(chunk, ignore_index=True)

But I got an error:

 TypeError: first argument must be an iterable of pandas objects, you passed an object of type "DataFrame"

How can I resolve it?

Have 1 answer(s) found.
  • D

    Dương Trang Quốc May 30 2021

    You need to append each chunk to a list and then use concat to concatenate them all:

    df2 = pd.read_csv('et_users.csv', header=None, names=names2, chunksize=100000)
chunks=[]
for chunk in df2:
    chunk['ID'] = chunk.ID.map(rep.set_index('member_id')['panel_mm_id'])
    chunks.append(chunk)

df2 = pd.concat(chunks, ignore_index=True)

    I hope it useful for you!!

Related Q&A May You Like

  1. ValueError: cannot reindex from a duplicate axis in Python
  2. ValueError: Cannot convert non-finite values (NA or inf) to integer in Python
  3. ModuleNotFoundError: No module named 'pandas' in Python
  4. How to print WITHOUT New line in Python using print method?
  5. How to print a new line in Python 3 with a long string?
  6. Short command to check python version in Linux or Window?
  7. SyntaxError: invalid character in identifier in Python
  8. ImportError: No module named 'ConfigParser' in Python
  9. ModuleNotFoundError: No module named 'numpy' in Python 3.x
  10. ImportError: No module named matplotlib.pyplot in Python
  11. Error divide by zero encountered in double_scalars in Python
  12. PermissionError: [Errno 13] Permission denied in Python
  13. ImportError: No module named MySQLdb in Python Django
  14. MongoDB throw certificate verify failed: certificate has expired in Python
  15. ImportError: No module named 'mysql' in Python Django
Leave An Answer
* NOTE: You need Login before leave an answer

* Type maximum 2000 characters.

* All comments have to wait approved before display.

* Please polite comment and respect questions and answers of others.

Most Quizs Popular

Start Test

Javascript - Functions
Start Test

Asp.Net Core - Exam test 01
Start Test

Asp.Net Core - Exam test 02
Start Test

C# - Level Beginner

Popular Tips

This site uses cookies so that we can remember you and understand how you interact with our website. This allows us to improve and customize your browsing experience. See our Cookies Policy.
X Close