Open8
Kaggleで使われる便利なコード集
![currypurin](https://res.cloudinary.com/zenn/image/fetch/s--t_SxAagT--/c_limit%2Cf_auto%2Cfl_progressive%2Cq_auto%2Cw_70/https://storage.googleapis.com/zenn-user-upload/avatar/3bd0e24141.jpeg)
memory profileが付いたtimer
with 文の箇所の実行時間と、CPUのメモリの増減が表示される
![currypurin](https://res.cloudinary.com/zenn/image/fetch/s--t_SxAagT--/c_limit%2Cf_auto%2Cfl_progressive%2Cq_auto%2Cw_70/https://storage.googleapis.com/zenn-user-upload/avatar/3bd0e24141.jpeg)
データフレームのメモリ使用量を返す
def sizeof_fmt(num, suffix='B'):
for unit in ['','Ki','Mi','Gi','Ti','Pi','Ei','Zi']:
if abs(num) < 1024.0:
return "%3.1f%s%s" % (num, unit, suffix)
num /= 1024.0
return "%.1f%s%s" % (num, 'Yi', suffix)
def get_memory_usage_from_df(df: pd.DataFrame()):
return sizeof_fmt(df.memory_usage(index=True).sum())
![currypurin](https://res.cloudinary.com/zenn/image/fetch/s--t_SxAagT--/c_limit%2Cf_auto%2Cfl_progressive%2Cq_auto%2Cw_70/https://storage.googleapis.com/zenn-user-upload/avatar/3bd0e24141.jpeg)
コードコンペの再実行(スコアリングのための実行)かどうか判別
if os.getenv('KAGGLE_IS_COMPETITION_RERUN'):
# Rerun-specific code
# (スコアリングのための実行)
else:
# Non-rerun code
# (スコアリング以外、commitなど)
![currypurin](https://res.cloudinary.com/zenn/image/fetch/s--t_SxAagT--/c_limit%2Cf_auto%2Cfl_progressive%2Cq_auto%2Cw_70/https://storage.googleapis.com/zenn-user-upload/avatar/3bd0e24141.jpeg)
Notebook開始時の画面(2022年6月)
# This Python 3 environment comes with many helpful analytics libraries installed
# It is defined by the kaggle/python Docker image: https://github.com/kaggle/docker-python
# For example, here's several helpful packages to load
import numpy as np # linear algebra
import pandas as pd # data processing, CSV file I/O (e.g. pd.read_csv)
# Input data files are available in the read-only "../input/" directory
# For example, running this (by clicking run or pressing Shift+Enter) will list all files under the input directory
import os
for dirname, _, filenames in os.walk('/kaggle/input'):
for filename in filenames:
print(os.path.join(dirname, filename))
# You can write up to 20GB to the current directory (/kaggle/working/) that gets preserved as output when you create a version using "Save & Run All"
# You can also write temporary files to /kaggle/temp/, but they won't be saved outside of the current session
from pathlib import Path
TMP_DIR = Path('../temp')
TMP_DIR.mkdir(exist_ok=True)
サンプル notebook https://www.kaggle.com/code/currypurin/kaggle-temp-folder