News
Open-source language AI challenges big tech’s models
An international team of around 1,000 largely academic volunteers has tried to break big tech’s stranglehold on natural-language processing and reduce its harms. Trained with US$7-million-worth of publicly funded computing time, the BLOOM language model will rival in scale those made by firms Google and OpenAI, but will be open-source. BLOOM will also be the first model of its scale to be multilingual.
The collaboration, called BigScience, launched an early version of the model on 17 June, and hopes that it will ultimately help to reduce harmful outputs of artificial intelligence (AI) language systems. Models that recognize and generate language are increasingly used by big tech firms in applications from chat bots to translators, and can sound so eerily human that a Google engineer this month claimed that the firm’s AI model was sentient (Google strongly denies that the AI possesses sentience). But such models also suffer from serious practical and ethical flaws, such as parroting human biases. These are difficult to tackle because the inner workings of most such models are closed to researchers.
As well being a tool to explore AI, BLOOM will be open for a range of research uses, such as extracting information from historical texts and making classifications in biology. “We think that access to the model is an essential step to do responsible machine learning,” says Thomas Wolf, co-founder of Hugging Face, a company that hosts an open-source platform for AI models and data sets, and has helped to spearhead the initiative.
“It was long overdue that this technology diffused into the open-source world, and this is quite an interesting way for it to have happened,” says Connor Leahy, co-founder of EleutherAI, which is creating its own open-source large language model in English and was not involved in the project.
Learning machines
Large language models are algorithms that learn statistical associations between billions of words and phrases to perform tasks such as generating summaries, translating, answering questions and classifying text. Built using brain-inspired architectures known as neural networks, the models train through adjusting values, called parameters, by blanking out words and comparing their predictions with reality. BLOOM has 176 billion parameters, on a par with GPT-3, one of the best-known such models, which was created by the non-profit firm OpenAI and licensed by Microsoft.
Although such models are sometimes impressive — generating poetry or correctly answering trivia questions — they have no sense of the meaning of language, which causes them to also create gibberish. More worryingly, they can also promote abuse or self-harm, and echo existing racist or sexist associations that are sewn throughout the human-written text they learn on, such as linking ‘Islam’ with terrorism. The models generally cost millions of dollars to train and have an enormous carbon footprint (BigScience eventually plans to reveal its carbon emissions).
Whereas most natural-language models are built by small in-house teams, BLOOM was the work of hundreds of researchers — mostly academics — including ethicists, legal scholars and philosophers, but also some employees from Facebook and Google, working in a personal capacity. To train BLOOM, BigScience was granted free access to France’s national Jean Zay supercomputer facility outside Paris. The model is currently in the last few weeks of its three-month training period.
Hand-picked text
Models are only as good as the data sets they are based on, so a major task was selecting what texts the model should learn from, says Yacine Jernite, a machine-learning researcher at Hugging Face. Most major models rip language directly from the web, including sites such as Reddit. Instead, the BigScience researchers hand-picked nearly two-thirds of their 341-billion-word data set from 500 sources. Among them was Semantic Scholar, an AI-backed search engine for academic publications that also includes content such as Nature news articles. The sources were suggested during a series of workshops, including with community groups, such as the African natural-language-processing community Masakhane, LatinX in AI and Machine Learning Tokyo. “We wanted to make sure people with proximity to the data, their country, the language they speak, had a hand in choosing what language came into the model’s training,” says Jernite.
To make full use of the computing power available, the team topped up the data trove using a multilingual web crawl, filtered for quality and with some redaction for privacy. The collaboration also attempted to reduce the usual over-representation of porn sites (which can lead to sexist associations in the model) but without excluding keywords that would remove content associated with frank discussion of sexuality in often under-represented communities.
Jernite acknowledges that BLOOM will not be free of biases. But by providing it with multicultural and high-quality sources, the team hopes to improve on existing models. Crucially, because the code and data set behind the model are open, researchers can try to understand the roots of harmful behaviours, which could improve future iterations, says Wolf.
Evaluation of the model will also differ from the usual benchmarks, says Ellie Pavlick, a natural-language-learning researcher at Brown University in Providence, Rhode Island. As well as comparing BLOOM against other models in its abilities to, for example, answer questions, researchers also want to look at more diverse metrics, such as how strongly it makes certain stereotyped associations or how biased its abilities are towards a specific language. Pavlick hopes that because the model has been trained to be multilingual, it might have a deeper understanding of language, which could help in its ability to generalize to a diversity of tasks.
Leahy predicts that the model might perform slightly worse than other large models in English, given its smaller data set in the language, but that should be balanced by markedly better performance elsewhere.
Free to use
The fully trained BLOOM model will be available to download for researchers who want to experiment with it or train it on new data for specific applications. But downloading it and running it requires significant hardware capacity. Because that’s available to so few research teams, BigScience will also publish smaller, less hardware-intensive versions as well as create a distributed system that allows labs to share the model across their servers. In addition, Hugging Face will release a web application that will enable anyone to query BLOOM without downloading it. A similar application will be available for the early release later this week.
BLOOM could find uses in research outside AI. Francesco de Toni, a linguist at the University of Western Australia in Perth, jointly leads a BigScience working group that is looking at using models to extract information from collections of historical texts that are too large to go through by hand. Models can, for example, extract all the names or goods mentioned in a collection of letters by Renaissance merchants — information that would be impossible to find using a search engine.
BLOOM comes with documentation that outlines its capabilities and limitations. Using it also requires signing up to an evolving legal licence that commits researchers to not use the model for malicious or inappropriate ends, such as generating fake news. The collaboration will monitor how the model is applied and adjust the license and documentation as necessary, says Giada Pistilli, an ethicist at Hugging Face and philosopher at the Sorbonne University in Paris who co-chaired BigScience’s ethical and legal working group. “It’s really hard to imagine and predict all the uses,” she says.
Discover the unparalleled shopping experience at Trader Joe’s, a renowned grocery store chain offering a wide range of high-quality products at affordable prices. Explore the diverse selection, innovative offerings, and friendly atmosphere that make Trader Joe’s a favorite destination for food enthusiasts.
Introduction: Welcome to Trader Joe’s
Trader Joe’s has revolutionized the grocery shopping industry with its distinctive approach to retail. With a commitment to providing unique and high-quality products, Trader Joe’s has garnered a loyal following of customers who are eager to explore the ever-changing assortment of items on their shelves. In this article, we will delve into the world of Trader Joe’s and explore the reasons why it stands out from the competition.
Trader Joe’s: A Shopper’s Paradise
A Haven for Food Enthusiasts
Trader Joe’s is more than just a grocery store; it’s a paradise for food enthusiasts. With an extensive selection of gourmet and specialty items sourced from around the world, Trader Joe’s caters to the discerning palate. From unique snacks and appetizers to artisanal cheeses and decadent desserts, there’s always something new and exciting to discover at Trader Joe’s.
Unbeatable Prices and Value
One of the hallmarks of Trader Joe’s is its commitment to providing exceptional value to its customers. While the store offers a wide range of high-quality products, it manages to keep its prices affordable. This combination of quality and value is what sets Trader Joe’s apart from its competitors, making it an attractive option for budget-conscious shoppers.
A Neighborhood Vibe
Step into any Trader Joe’s, and you’ll immediately notice the warm and welcoming atmosphere. With friendly staff members who are always ready to assist you, shopping at Trader Joe’s feels like a visit to your neighborhood store. The company prides itself on fostering a sense of community and creating an enjoyable shopping experience for its customers.
Exploring Trader Joe’s Selection
A Cornucopia of Fresh Produce
Trader Joe’s offers an impressive selection of fresh fruits and vegetables, sourced from trusted suppliers. Whether you’re in search of everyday staples or exotic produce, Trader Joe’s has you covered. From crisp apples to vibrant heirloom tomatoes, their produce section boasts a colorful array of options that will inspire any home cook.
Delightful Dairy and Cheese Selection
Cheese lovers rejoice! Trader Joe’s is renowned for its diverse selection of cheeses from around the world. From creamy Brie to tangy blue cheese, you’ll find a range of flavors and textures to suit your taste buds. Pair your favorite cheese with their assortment of crackers and you’re in for a treat.
International Flavors Galore
At Trader Joe’s, you can embark on a global culinary adventure without leaving the store. Their shelves are stocked with a wide variety of international ingredients and products, allowing you to explore different cuisines and expand your culinary horizons. Whether you’re in the mood for Thai curry, Italian pasta, or Indian spices, Trader Joe’s has everything you need to create authentic and flavorful dishes.
Unique and Innovative Offerings
One of the reasons why Trader Joe’s is so beloved is its constant introduction of unique and innovative products. The store takes pride in being a trendsetter in the grocery industry, and customers eagerly anticipate the arrival of new items. From seasonal treats to unexpected flavor combinations, Trader Joe’s never fails to surprise and delight its customers.
Frequently Asked Questions (FAQs)
1. What makes Trader Joe’s different from other grocery stores?
Trader Joe’s stands out from other grocery stores due to its unique selection of products, unbeatable prices, and friendly atmosphere. The store offers an exciting array of gourmet and specialty items, all at affordable prices,making it a destination for food enthusiasts. Additionally, Trader Joe’s prides itself on creating a neighborhood vibe with its welcoming staff and sense of community.
2. Does Trader Joe’s offer organic and healthy options?
Yes, Trader Joe’s is known for its commitment to offering a wide range of organic and healthy options. The store carries a variety of organic produce, as well as organic dairy products, meats, and pantry staples. In addition, Trader Joe’s has a selection of gluten-free, vegan, and vegetarian products to cater to different dietary preferences and needs.
3. Are Trader Joe’s products affordable compared to other grocery stores?
Yes, Trader Joe’s is renowned for its affordability. While providing high-quality products, Trader Joe’s manages to keep its prices competitive. This combination of quality and value makes it an attractive choice for shoppers looking to get the most out of their budget.
4. Can I find international ingredients and spices at Trader Joe’s?
Absolutely! Trader Joe’s takes pride in offering a diverse range of international ingredients and spices. Whether you’re looking for exotic spices for a specific recipe or unique international snacks, Trader Joe’s has a selection that will satisfy your culinary cravings.
5. Are there any Trader Joe’s branded products?
Yes, Trader Joe’s has its own line of branded products. These Trader Joe’s branded items are carefully curated and developed to meet the company’s high standards for quality and taste. From snacks and pantry staples to frozen meals and beverages, you’ll find a variety of Trader Joe’s branded products throughout the store.
6. Does Trader Joe’s have a return policy?
Yes, Trader Joe’s has a customer-friendly return policy. If you’re not satisfied with a product you’ve purchased, you can return it to the store with a receipt for a full refund. Trader Joe’s aims to ensure customer satisfaction and stands behind the quality of their products.
Conclusion: A Shopping Experience Like No Other
Trader Joe’s offers a shopping experience that is truly unique. With its diverse and high-quality product selection, unbeatable prices, and friendly atmosphere, it has become a favorite destination for food enthusiasts and budget-conscious shoppers alike. Whether you’re searching for everyday essentials, international ingredients, or innovative snacks, Trader Joe’s has something to offer. So, the next time you’re in search of a grocery store adventure, don’t miss out on the vibrant and exciting world of Trader Joe’s.
Uncover the extraordinary story of the Rebbe’s Dollar distribution, a powerful tradition that has transformed lives and inspired acts of kindness across the globe.
The Rebbe’s one-dollar bill, a symbol of charity and compassion, continues to embody the spiritual legacy of Rabbi Menachem Mendel Schneerson, inspiring countless individuals to embrace a life of giving and kindness.
Every Sunday, people from all walks of life – Jews and non-Jews alike – would line up outside the Rebbe’s residence at 770 Eastern Parkway in Brooklyn, New York, eager to receive a dollar bill and a blessing from the Rebbe.
It was a testament to the universal nature of the Rebbe’s message of love, kindness, and the power of good deeds.
The Rebbe would hand out dollar bills to each individual, instructing them to donate the money to a charity of their choice. Through this small act of giving, the Rebbe instilled the value of charity and the potential of a single dollar to create positive change.
The use of lab grown diamonds NZ in jewellery has been growing rapidly over the last few years. This is because they are eco-friendly, and they cost less than mined diamonds. However, it is essential to understand the differences between a lab-grown and a mined diamond before making a purchase decision.
A Lab-Grown Diamond is a synthetic diamond created by humans in a lab instead of being mined from the ground. They are similar to natural diamonds in almost every way, except that they do not cloud or lose their luster over time.
There are several processes that can be used to grow a diamond in a lab, but the most common ones are High Pressure-High Temperature (HPHT) and Chemical Vapor Deposition (CVD). These methods are incredibly complex, but they have the same end goal: to replicate the conditions that naturally occur when a diamond grows on the earth’s surface.
Unlike mined diamonds, formed after millions of years of exposure to extreme heat and temperatures within the earth’s crust, lab-grown diamonds are created by scientists in a controlled environment. This allows them to mimic the same physical and chemical properties of natural diamonds, while also being significantly cheaper and environmentally friendly.
How They’re Made
When a diamond seed is placed inside of a sealed chamber, it is pressurized and heated until the carbon particles break down and crystallize into a fully grown diamond. This process is called growing a diamond in a lab, and many companies have done it since the 1960s.
In addition to being more sustainable, lab-grown diamonds are more ethical than mined diamonds because they don’t heavily impact the environment. For example, a study by Frost & Sullivan found that for each carat of diamonds mined using traditional methods, nearly 100 square feet of land is disturbed and more than 5,798 pounds of mineral waste are created.
Another great thing about lab-grown diamonds is that they don’t consume as much water in the making process. This is because the processes involved in creating a mined diamond require significant amounts of water, and they also create a lot of pollution.
This can lead to many issues, including depleted water supplies and environmental calamities. In addition, the soil can be destroyed, and in turn, the land is rendered unusable once mining operations have ceased.
It is also worth noting that lab-grown diamonds don’t contribute to global warming like mined diamonds, as their carbon is sourced from CO2 emissions. This is a very good thing for the planet, and it is one of the major reasons why people are switching to lab-grown diamonds instead of mined diamonds.
If you want to buy a piece of jewellery with a lab-grown diamond, you’ll need to do some research and make sure that you are getting a good deal on the product. You can do this by checking out prices at different retailers and comparing the costs. You can then choose which option is best for you and your budget.
-
News9 months ago8 Birthday Gift Ideas for Friends or Family Who ‘Have Everything
-
Entertainment9 months agoThe 10 Best Subway Sandwiches, Ranked
-
Celebrity1 month agoDavid Bolno: A profile in philanthropy
-
Tech9 months ago5 Common Acer Laptop Problems
-
News9 months ago
Free iPhone 12 from the Government
-
News11 months ago
Grafikky 2.0 APP Review — What Is Grafikky 2.0? Is It Legit In 2022?
-
News10 months agoplex online login
-
Tech9 months agoWHY DO TRADERS BEHAVE DIFFERENTLY WHEN LOOKING AT THE SAME MARKET DATA?