Sort project search filters by popularity by default

[tmose1106]

I have just recently started looking around "The Warehouse", and I have noticed some little quirks. The biggest one being how quirky the project filters in the package search are. Some glaring things I have noticed (Which mostly revolve around alphabetizing):

• There is a programming language search that does not have Python and all of its options up top. I doubt anyone is coming on PyPi to look for the latest Awk code, which gets higher billing than Python itself. While I do enjoy alphabetizing, I don't think this is the right time for it.
• The license search is similarly sorted, also causing issues. While I understand this follows the Setuptools categories layout, it is just not functional. If someone wishes to search for a license, they are probably looking for a package under a more permissive license like the BSD or MIT. They are probably not going to check OSI Approved, nor the Aladdin Free Public License (AFPL) (whatever that is).
• The Operating System sort is even more laughable, given it has a Windows 3.1 or Earlier option. Again, while it is a valid category in the standard categories, we need to look at what is realistic. Linux being at the bottom of the list is just plain silly.

My suggestion would be to have a popular section or something of the sort at the top of each filter, where the most common categories will be. And for the languages, just moving Python up top of the list, since I would assume 99% of people are looking for Python packages. And if developers began marking the Python version categories correctly, we would have a much better system.

[brainwane]

@tmose1106 I'm sorry for the delay in response here. The folks working on Warehouse have gotten limited funding to concentrate on improving and deploying Warehouse, and have kicked off work towards our development roadmap -- the most urgent task is to improve Warehouse to the point where we can redirect pypi.python.org to pypi.org so the site is more sustainable and reliable. Along the way we've been trying to reply to issues that need replies -- I missed getting to this earlier and I'm sorry about that.

Nicole (@nlhkabu) has written up her design goals, including her assessment of the legacy UI and its problems, at http://whoisnicoleharris.com/2015/12/31/designing-warehouse-an-overview.html . She's doing user tests to get more data on what users have trouble with, and during those tests, asking about things like filtering, search, and the classifiers.

Volunteers @waseem18 and @cryvate have been working on search, filters, and sorting -- I'd welcome their thoughts on implementing your suggestions.

Now that the team is well underway, we'll be faster at responding to new issues and comments -- sorry again for the wait.

[brainwane]

(I will say that I personally do look for projects under OSI-approved licenses, but I acknowledge that I may be a weirdo. :) )

[brainwane]

Here's my take on this:

Figuring out how to best display and help people select from the 650+ trove classifiers while filtering search results is hard. I recognize that there are good reasons for keeping things alphabetical within, for instance, the Natural Language section and Intended Audience, but also that there are good reasons to arrange by popularity in, for instance, the Operating System sort or the Framework sort, and it would make a lot of sense to me to bring Python and its subcategories to the top of the Programming Language sort (to help people filter by support for particular Python versions).

I'm sure https://pypi.org/search/ will see a lot more permutation as @nlhkabu does more user testing.

@berkerpeksag specified the current ordering of categories in 7da236d as:

+SEARCH_FILTER_ORDER = (
+    "Programming Language",
+    "License",
+    "Framework",
+    "Topic",
+    "Intended Audience",
+    "Environment",
+    "Operating System",
+    "Natural Language",
+    "Development Status",
+)

@berkerpeksag I want to know how strongly you feel about this particular ordering. My inclination would be (and I know there's a risk of bikeshedding here): let's rearrange it as follows, based on my rough understanding of how useful these classifiers currently are:

"Framework",
"Development Status"
"Topic",
"Intended Audience",
"Programming Language",
"License",
"Operating System",
"Environment",
"Natural Language"

[berkerpeksag]

@brainwane your suggestion sounds good to me, thanks. For reference, I took the original ordering from #1298 (comment) and #1298 (comment).

[berkerpeksag]

@brainwane I would put "Programming Language" to top if "Python" was the first item in the programming language list. Currently, it's way down in the list and it's not very useful. Perhaps we should move Python to top? I just implemented my suggestion via Chrome Devtools: