289,197 questions
- Bountied 0
- Unanswered
- Frequent
- Score
- Trending
- Week
- Month
- Unanswered (my tags)
0
votes
0
answers
34
views
Python SQLAlchemy: Integrity Error UNIQUE constraint failed despite no duplicates
Summary
I'm trying to save some data I have in a CSV to a SQLite database using SQLAlchemy in a Jupyter Notebook. When trying to flush or merge the session data for the junction tables, I receive an ...
Advice
3
votes
3
replies
49
views
Reading in XML data in python
I am looking for some assistance with how to convert the below XML data into a dataframe.
I have managed to write a working code in R (XML package, code is messy) but then I realised it might even be ...
4
votes
2
answers
192
views
Pandas rolling window over a time period if some data might be missing within groups
I have a dataset with a column of groups, dates, day of the week and some data columns. For each date in each group, I want to work out the same day average from the last 3 weeks (l3w). I've been ...
2
votes
3
answers
102
views
Python packages installation - pandas & nympy
I have read close to all posts about this topic now but I can get it working, so sorry if you find this similar to other questions, but I can't just solve it based on existing posts.
I find it very ...
Advice
0
votes
1
replies
37
views
Pandas segfaults when attempting to read a multi-line cell
I have a set of TSV files that are filled by serializing pandas dataframes built on the responses I get from querying a large database using GraphQL. In the response I get, I have a field that hosts ...
-2
votes
2
answers
92
views
Pandas is saving a column as a float even though I converted to str using .astype [closed]
I am trying to save a string that will be used as a formula in google sheets.
import os
import re
from pathlib import Path
import pathlib
import glob
import gspread
from pydrive2.auth import ...
1
vote
1
answer
88
views
Nuitka & PyQt6 specifying imports to reducing exe size (currently ~1gb)
I'm working on a project to develop a simple app, based on a Python script for data analysis, using PyQt6 to format the app, and using Nuitka to create an exe. (Yes, I've tried using PyInstaller. My ...
3
votes
1
answer
75
views
faster methods to remove substrings stored in one column from strings stored in another column
hist_df_2["time"] = hist_df_2.apply(lambda row : hist_df_2['timestamp'].replace(str(hist_df_2['date']), ''), axis=1)
I tried this to remove the date part from the timestamp. However, for ...
1
vote
1
answer
129
views
Broadcasting DataFrames across NumPy array dimensions
I'm working with a large Pandas DataFrame and a multi-dimensional NumPy array. My goal is to efficiently "broadcast" a specific column of the DataFrame across one or more dimensions of the ...
-1
votes
0
answers
83
views
Best approaches to applying a function to more than one column in df at once? [duplicate]
Say I have a pandas dataframe of > 2 columns and > 2 rows, I want to apply a function, such as a datatype conversion, to each element in at least two columns. I would like for it to be efficient,...
5
votes
3
answers
249
views
How to query columns that are lists or dicts?
How can I query columns that are lists or dicts? Here is some basic JSON-like data.
[
{
"id": 1,
"name": "John Doe",
"age": 30,
&...
-1
votes
0
answers
41
views
Replacing dataframe column with a subset of a value from another column [duplicate]
I'm trying to replace the value in a dataframe column with the partial value from another dataframe column and not having any luck.
I have this:
import pandas as pd
df = pd.DataFrame({'Action': ['set'...
1
vote
3
answers
114
views
Access data frame from binary file
if I have saved a data frame using pickle in a binary file how can I access it?
def create_dataset(path):
"""
creates an binary file with dataset saved in it.
"&...
-3
votes
2
answers
112
views
How to print the value counts of a user-selected column in a pandas DataFrame? [closed]
I’m trying to write a Python script that allows the user to input the name of a column and then prints the value counts of that column from a pandas DataFrame. Here's what I currently have:
def ...
0
votes
1
answer
56
views
When big data : requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))
The problem appears when i have a big amount of values in my pandas df. When i take 27 or 54 values(1 or 2 columns) it works normaly, but when i take more columns it gives me this erorr (i import gs ...