Artificial Idiot, Eh

Chinese-Llama-2-7b-hf is extremely unreliable, runs very slowly, and often crashes.

Chinese-Llama-2-7b-4bit — this one made me laugh out loud: its output just won't stop, looping endlessly.

What are husband-and-wife lung slices (Fuqi Feipian)?

Husband-and-wife lung slices refer to lung slices between a couple, that is, the lung structure between a couple. Husband-and-wife lung slices refer to the lung structure between a couple, which is the lung structure between a couple.........

chatGLM2-6B is also pretty good.

Introduce Fuqi Feipian (Husband-and-Wife Lung Slices)?

Fuqi Feipian is a traditional Sichuan specialty dish that originated in 1898 and now has over 120 years of history. It uses pig lung and beef lung as its main ingredients. Through refined culinary technique, it presents a numbing, spicy, and fragrant flavor with a clear broth color and tender, succulent meat. The main seasonings of Fuqi Feipian include dried chili peppers, Sichuan peppercorns, douban chili paste, cooking wine, ginger, garlic, ground Sichuan pepper, light soy sauce, dark soy sauce, salt, sugar, chicken bouillon, and more. During cooking, Fuqi Feipian also incorporates special spices such as star anise, cinnamon, cloves, and tsao-ko, making the dish even more delicious and flavorful. Fuqi Feipian is a Sichuan dish with excellent color, aroma, and flavor, characterized by its numbing-spicy fragrance, clear broth color, and tender meat. It is not only a delicious delicacy but also one of the representatives of Sichuan cuisine.

chatGLM2-6B has a version that supports 32K context. I tested it — when a single piece of context text is too long (placed directly into history), it becomes so slow it feels like a system hang. Worth mentioning: after loading, chatGLM2 can actually run on my ancient Mac. Text generation speed is a bit slow, but still acceptable.

Qwen-7B-Chat and Qwen-7B-Chat-Int4 — Alibaba's Qwen (Tongyi Qianwen) is quite good, with fast loading and snappy responses.

Introduce Fuqi Feipian?

Fuqi Feipian is a traditional Chinese dish consisting mainly of sliced beef lung and pig lung. Its origins can be traced back to the Qing Dynasty, when a husband and wife opened a restaurant and sliced beef lung and pig lung into thin pieces, then cooked them together. Because of the dish's delicious taste, it quickly became the restaurant's signature dish.
The cooking method of Fuqi Feipian is very unique: the beef and pig lung slices must be boiled, then seasoned with chili peppers, Sichuan peppercorns, minced garlic, chopped green onions, and other condiments, and finally finished with hot oil, stir-fried until evenly combined. The dish is characterized by being spicy without being drying, with a delicious taste, and is extremely popular.
In addition to traditional Fuqi Feipian, there are now many variations — for example, adding ingredients such as tofu, celery, and wood ear mushrooms, or using chicken, duck, or other meats in place of beef and pig lung slices. Whichever version it is, it is an extremely delicious dish deeply loved by the Chinese people.

Its Int4 quantization is implemented using auto-gptq. It is claimed that the post-quantization quality is nearly identical, and my hands-on testing indeed confirms it performs well.

For Baichuan, I used the 13B version, but loading was far too slow — it took several minutes to finish loading. It uses the common transformers approach of loading into CPU memory first, then quantizing to 8-bit and loading into GPU memory. The quality turned out okay, but the loading process itself took a truly long time — a full 8 minutes — and it occupies roughly 20GB of VRAM.

Introduce Fuqi Feipian

Fuqi Feipian is a traditional Sichuan specialty dish originating from Chengdu, Sichuan Province. This dish is world-renowned for its unique taste and rich nutritional value. The main ingredients of Fuqi Feipian are pig lung, beef, and beef tripe, with spices such as Sichuan peppercorns, chili peppers, star anise, and bay leaves as accompaniments. In the preparation process, these ingredients are sliced thin and then tossed together with vegetables such as bean sprouts, soybeans, and peanuts. Finally, special seasonings such as chili oil, Sichuan pepper oil, light soy sauce, vinegar, and white sugar are added to enrich the flavor. Fuqi Feipian is characterized by a bright red color, numbing-spicy fragrance, and a smooth, tender texture. This dish is not only wonderfully tasty but also has certain medicinal value, providing good nourishment for the body. Therefore, Fuqi Feipian has become a classic delicacy of Sichuan cuisine, widely praised and loved.

Generating that one response took about 30 seconds. Asking the same question again took around half a minute as well.

Since it is relatively slow, I quantized it to 4-bit. It takes about 7GB of disk space, and loading is clearly much faster. I tried asking a few questions, and the quality is still good.

List the hexagram images of the Earlier Heaven Eight Trigrams

The Earlier Heaven Eight Trigrams (Xiantian Bagua) is an ancient eight-trigram diagram created by Fuxi, based on Yin and Yang, dividing all things in the universe into eight fundamental types. The hexagram images of the Earlier Heaven Eight Trigrams are as follows: 1. Qian trigram: represents Heaven — all three lines are Yang, i.e., ☰. 2. Dui trigram: represents Marsh — of the three lines, the top is Yin and the bottom is Yang, i.e., ☱. 3. Zhen trigram: represents Thunder — of the three lines, the left is Yang and the right is Yin, i.e., ☳. 4. Li trigram: represents Fire — of the three lines, two are Yang and one is Yin, i.e., ☲. 5. Xun trigram: represents Wind — of the three lines, the top is Yin and the bottom is Yang, i.e, ☴. 6. Kan trigram: represents Water — of the three lines, the outer is Yang and the inner is Yin, i.e., ☵. 7. Gen trigram: represents Mountain — of the three lines, the top has two vertical strokes and the bottom one horizontal, i.e., ☶. 8. Kun trigram: represents Earth — all three lines are Yin, i.e., ☷. These hexagram images represent the fundamental elements and phenomena of nature, as well as their interrelationships.