copy_from does not support CSV field quoting. Use copy_expert instead:
copy_from
copy_expert
cur.copy_expert(f""" COPY {tablename} (col1, col2, ...) FROM STDIN WITH (FORMAT CSV) """, csv_file_stream)