<aside> 💡 실전경진대회AICONNECT https://aiconnect.kr/competition/detail/246/task/324/taskInfo

• ssh -i 05.pem -L 2222:localhost:2222 [[email protected]](<mailto:[email protected]>)> /dev/null 2>&1
• ssh -p 2222 root@localhost
• config

# Read more about SSH config files: <https://linux.die.net/man/5/ssh_config>
Host Five
    HostName localhost
    User root
    Port 2222

</aside>

<aside> <img src="/icons/chart-line_lightgray.svg" alt="/icons/chart-line_lightgray.svg" width="40px" /> inference.py 실행

• CUDA_VISIBLE_DEVICES=0,1,2,3 python3 inference.py --model_path /workspace/nlp/05/baseline/results/LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct/trial-2
• CUDA_VISIBLE_DEVICES=0,1,2,3 python3 inference.py --model_path Qwen/Qwen2-72B-Instruct-GPTQ-Int4 </aside>

<aside> 💡 ISIC KAGGLE https://www.kaggle.com/code/motono0223/isic-tabular-model-image-model-features

• ssh -p 50102 [[email protected]](<mailto:[email protected]>)
• g4Q9Mnux
• config

# Read more about SSH config files: <https://linux.die.net/man/5/ssh_config>
Host 05
    HostName 115.71.1.85
    User root
    Port 50102

</aside>

<aside> <img src="/icons/chart-line_lightgray.svg" alt="/icons/chart-line_lightgray.svg" width="40px" /> Llama3.1 70B

• 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

Llama3.1 70B int4

• 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

Llama3.1 8B

• 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 </aside>

<aside> <img src="/icons/chart-line_lightgray.svg" alt="/icons/chart-line_lightgray.svg" width="40px" /> Exaone

• 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 </aside>

<aside> <img src="/icons/chart-line_lightgray.svg" alt="/icons/chart-line_lightgray.svg" width="40px" /> 완디비 wandb

• d5a13a7c48763dce9d91aedf4741eafa99791788 </aside>

<aside> <img src="/icons/chart-line_lightgray.svg" alt="/icons/chart-line_lightgray.svg" width="40px" /> Qwen/Qwen2_gptq_int4

• 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 </aside>

<aside> <img src="/icons/chart-line_lightgray.svg" alt="/icons/chart-line_lightgray.svg" width="40px" /> Qwen/Qwen2-7B-Instruct-AWQ

• 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 </aside>

<aside> <img src="/icons/chart-line_lightgray.svg" alt="/icons/chart-line_lightgray.svg" width="40px" /> Qwen/Qwen2_7b_instruct

• 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 </aside>

python -m sglang.launch_server --model-path /USER/Project/05/LLM_prac/models/Qwen2-7B-Instruct --port 30000