Skip to content

Improve Windows support: quick start guide + pkg_resources compatibility fix - #464

Closed
ahmedTmersal wants to merge 3 commits into
tatsu-lab:mainfrom
ahmedTmersal:fix/windows-example
Closed

ahmedTmersal wants to merge 3 commits into
tatsu-lab:mainfrom
ahmedTmersal:fix/windows-example

Conversation

@ahmedTmersal

@ahmedTmersal ahmedTmersal commented Jun 26, 2026 •

Copy link
Copy Markdown

Description :

This PR improves Windows support for AlpacaEval by adding a clear quick start guide and fixing a compatibility issue related to deprecated dependencies.

Windows Quick Start Guide :

This PR adds a simple Windows quick start guide to help new users set up and run AlpacaEval on Windows environments.

It includes:

Setting up a virtual environment (Python 3.11 recommended)
Installing the package in editable mode
Verifying CLI installation
Basic usage instructions for Windows users

This improves onboarding experience for users facing setup issues on Windows.

Compatibility Fix :

This PR also fixes a compatibility issue in modern Python environments where pkg_resources (from setuptools) may not be available or is deprecated.

Problem:

Some Windows / Python 3.11+ environments raised:

ModuleNotFoundError: No module named 'pkg_resources'
Solution:

Replaced usage of pkg_resources with modern alternatives:

importlib.metadata for retrieving package versions
packaging.version.parse for version comparison
Impact:
Fixes installation/runtime issues on Windows
Improves compatibility with Python 3.11+
Removes dependency on deprecated setuptools API
No changes to core evaluation logic or model outputs
Notes:

This change was tested locally on Windows environments with Python 3.11 and Python 3.14.

@ahmedTmersal ahmedTmersal changed the title Add Windows quick start guide for AlpacaEval Improve Windows support: quick start guide + pkg_resources compatibility fix Jun 26, 2026
@ahmedTmersal
ahmedTmersal deleted the fix/windows-example branch June 26, 2026 23:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant