Llama ( Large Language Model Meta AI , formerly stylized as LLaMA ) is a family of autoregressive large language models (LLMs) released by Meta AI starting in February 2023. The latest version is Llama 3.2, released in September 2024.
162-570: Model weights for the first version of Llama were made available to the research community under a non-commercial license, and access was granted on a case-by-case basis. Unauthorized copies of the model were shared via BitTorrent . In response, Meta AI issued DMCA takedown requests against repositories sharing the link on GitHub . Subsequent versions of Llama were made accessible outside academia and released under licenses that permitted some commercial use. Llama models are trained at different parameter sizes, ranging between 1B and 405B. Originally, Llama
324-633: A BASIC interpreter for the device. Gates called MITS and claimed that he had a working interpreter, and MITS requested a demonstration. Allen worked on a simulator for the Altair while Gates developed the interpreter, and it worked flawlessly when they demonstrated it to MITS in March 1975 in Albuquerque, New Mexico . MITS agreed to distribute it, marketing it as Altair BASIC . Gates and Allen established Microsoft on April 4, 1975, with Gates as CEO, and Allen suggested
486-525: A Microsoft operating system or a non-Microsoft operating system. In effect, the royalty payment to Microsoft when no Microsoft product is being used acts as a penalty, or tax, on the OEM's use of a competing PC operating system. Since 1988, Microsoft's use of per processor licenses has increased." Following Bill Gates's internal "Internet Tidal Wave memo" on May 26, 1995, Microsoft began to redefine its offerings and expand its product line into computer networking and
648-448: A call must verify on their respective ends. On October 7, Microsoft acquired Ally.io, a software service that measures companies' progress against OKRs . Microsoft plans to incorporate Ally.io into its Viva family of employee experience products. On January 18, 2022, Microsoft announced the acquisition of American video game developer and holding company Activision Blizzard in an all-cash deal worth $ 68.7 billion. Activision Blizzard
810-517: A chain of Microsoft-branded retail stores, and on October 22, 2009, the first retail Microsoft Store opened in Scottsdale, Arizona ; the same day Windows 7 was officially released to the public. Windows 7's focus was on refining Vista with ease-of-use features and performance enhancements, rather than an extensive reworking of Windows. As the smartphone industry boomed in the late 2000s, Microsoft had struggled to keep up with its rivals in providing
972-541: A chance to join the swarm. Although "swarming" scales well to tolerate "flash crowds" for popular content, it is less useful for unpopular or niche market content. Peers arriving after the initial rush might find the content unavailable and need to wait for the arrival of a "seed" in order to complete their downloads. The seed arrival, in turn, may take long to happen (this is termed the "seeder promotion problem"). Since maintaining seeds for unpopular content entails high bandwidth and administrative costs, this runs counter to
1134-717: A combination of AI, high-performance computing and quantum computing . The service includes Copilot, a GPT-4 based large language model tool to query and visualize data, write code, initiate simulations, and educate researchers. At a November 2023 developer conference, Microsoft announced two new custom-designed computing chips: The Maia chip, designed to run large language models, and Cobalt CPU, designed to power general cloud services on Azure. On November 20, 2023, Satya Nadella announced that Sam Altman , who had been ousted as CEO of OpenAI just days earlier, and Greg Brockman , who had resigned as president, would join Microsoft to lead
1296-515: A completely new user interface with a novel start button , and 32-bit compatibility; similar to NT, it provided the Win32 API. Windows 95 came bundled with the online service MSN , which was at first intended to be a competitor to the Internet, and (for OEMs) Internet Explorer , a Web browser . Internet Explorer has not bundled with the retail Windows 95 boxes, because the boxes were printed before
1458-421: A cost: downloads can take time to rise to full speed because it may take time for enough peer connections to be established, and it may take time for a node to receive sufficient data to become an effective uploader. This contrasts with regular downloads (such as from an HTTP server, for example) that, while more vulnerable to overload and abuse, rise to full speed very quickly, and maintain this speed throughout. In
1620-454: A data file treats the file as a number of identically sized pieces, usually with byte sizes of a power of 2, and typically between 32 KB and 16 MB each. The peer creates a hash for each piece, using the SHA-1 hash function, and records it in the torrent file. Pieces with sizes greater than 512 KB will reduce the size of a torrent file for a very large payload, but is claimed to reduce
1782-452: A day after hosting a Sting concert for 50 people, including Microsoft executives, in Davos , Switzerland. On January 23, 2023, Microsoft announced a new multi-year, multi-billion dollar investment deal with ChatGPT developer OpenAI . In June 2023, Microsoft released Azure Quantum Elements to run molecular simulations and calculations in computational chemistry and materials science using
SECTION 10
#17328589808401944-399: A decentralized network of nodes that route traffic to dynamic trackers. Most BitTorrent clients also use peer exchange (PEX) to gather peers in addition to trackers and DHT . Peer exchange checks with known peers to see if they know of any other peers. With the 3.0.5.0 release of Vuze, all major BitTorrent clients now have compatible peer exchange. Web "seeding" was implemented in 2006 as
2106-547: A deluxe version for $ 399.99. Increasingly present in the hardware business following Xbox, Microsoft 2006 released the Zune series of digital media players, a successor of its previous software platform Portable Media Center . These expanded on previous hardware commitments from Microsoft following its original Microsoft Mouse in 1983; as of 2007 the company sold the best-selling wired keyboard ( Natural Ergonomic Keyboard 4000 ), mouse ( IntelliMouse ), and desktop webcam ( LifeCam ) in
2268-595: A draft on their website) that is incompatible with that of Azureus. In 2014, measurement showed concurrent users of Mainline DHT to be from 10 million to 25 million, with a daily churn of at least 10 million. Current versions of the official BitTorrent client, μTorrent , BitComet , Transmission and BitSpirit all share compatibility with Mainline DHT. Both DHT implementations are based on Kademlia . As of version 3.0.5.0, Azureus also supports Mainline DHT in addition to its own distributed database through use of an optional application plugin. This potentially allows
2430-509: A file, but also have a few consequences: As of December 2008, BitTorrent, Inc. was working with Oversi on new Policy Discover Protocols that query the ISP for capabilities and network architecture information. Oversi's ISP hosted NetEnhancer box is designed to "improve peer selection" by helping peers find local nodes, improving download speeds while reducing the loads into and out of the ISP's network. Microsoft Microsoft Corporation
2592-405: A focus of research was up-scaling models which in some instances showed major increases in emergent capabilities. The release of ChatGPT and its surprise success caused an increase in attention to large language models. Compared with other responses to ChatGPT, Meta's Chief AI scientist Yann LeCun stated that large language models are best for aiding with writing. An empirical investigation of
2754-455: A good connection between them do not exchange data simply because neither of them takes the initiative. To counter these effects, the official BitTorrent client program uses a mechanism called "optimistic unchoking", whereby the client reserves a portion of its available bandwidth for sending pieces to random peers (not necessarily known good partners, or "preferred peers") in hopes of discovering even better partners and to ensure that newcomers get
2916-469: A graphical extension for MS-DOS , despite having begun jointly developing OS/2 with IBM that August. Microsoft moved its headquarters from Bellevue to Redmond, Washington , on February 26, 1986, and went public on March 13, with the resulting rise in stock making an estimated four billionaires and 12,000 millionaires from Microsoft employees. Microsoft released its version of OS/2 to original equipment manufacturers (OEMs) on April 2, 1987. In 1990,
3078-576: A hybrid mode to ensure support for legacy clients. The BitTorrent protocol can be used to reduce the server and network impact of distributing large files. Rather than downloading a file from a single source server, the BitTorrent protocol allows users to join a "swarm" of hosts to upload and download from each other simultaneously. The protocol is an alternative to the older single source, multiple mirror sources technique for distributing data, and can work effectively over networks with lower bandwidth . Using
3240-419: A hybrid mode where the torrents are hashed through both the new method and the old method, with the intent that the files will be shared with peers on both v1 and v2 swarms. Another update to the specification is adding a hash tree to speed up time from adding a torrent to downloading files, and to allow more granular checks for file corruption. In addition, each file is now hashed individually, enabling files in
3402-463: A joint venture with NBC since 1996. On October 1, Microsoft announced its intention to launch a news operation, part of a new-look MSN , with Windows 8 later in the month. On October 26, 2012, Microsoft launched Windows 8 and the Microsoft Surface . Three days later, Windows Phone 8 was launched. To cope with the potential for an increase in demand for products and services, Microsoft opened
SECTION 20
#17328589808403564-465: A later date, without the loss of previously downloaded information, which in turn makes BitTorrent particularly useful in the transfer of larger files. This also enables the client to seek out readily available pieces and download them immediately, rather than halting the download and waiting for the next (and possibly unavailable) piece in line, which typically reduces the overall time of the download. This eventual transition from peers to seeders determines
3726-407: A list of all the torrents shared by the peers it connected to in the current session (or it can even maintain the list between sessions if instructed). At any time the user can search into that Torrent Collection list for a certain torrent and sort the list by categories. When the user chooses to download a torrent from that list, the .torrent file is automatically searched for (by info-hash value) in
3888-519: A major target of the controversy, will leave the company after the acquisition is finalized. The deal was closed on October 13, 2023. In December 2022, Microsoft announced a new 10-year deal with the London Stock Exchange Group for products including Microsoft Azure; Microsoft acquired around 4% of LSEG as part of the deal. In January 2023, CEO Satya Nadella announced Microsoft would lay off some 10,000 employees. The announcement came
4050-407: A military tool using Llama , which Meta Platforms stated was unauthorized due to its model use prohibition for military purposes. Wired describes the 8B parameter version of Llama 3 as being "surprisingly capable" given its size. The response to Meta's integration of Llama into Facebook was mixed, with some users confused after Meta AI told a parental group that it had a child. According to
4212-611: A mode for the Windows operating system rather than a separate and unique operating system. In March the company also established guidelines that censor users of Office 365 from using profanity in private documents. In April 2018, Microsoft released the source code for Windows File Manager under the MIT License to celebrate the program's 20th anniversary. In April the company further expressed willingness to embrace open source initiatives by announcing Azure Sphere as its own derivative of
4374-555: A modern smartphone operating system, falling behind Apple and Google -sponsored Android in the United States. As a result, in 2010 Microsoft revamped their aging flagship mobile operating system, Windows Mobile , replacing it with the new Windows Phone OS that was released in October that year. It used a new user interface design language, codenamed "Metro", which prominently used simple shapes, typography, and iconography, utilizing
4536-410: A modest cost. The model files were officially removed on March 21, 2023, over hosting costs and safety concerns, though the code and paper remain online for reference. Meditron is a family of Llama-based finetuned on a corpus of clinical guidelines, PubMed papers, and articles. It was created by researchers at École Polytechnique Fédérale de Lausanne School of Computer and Communication Sciences, and
4698-574: A motion-sensing input device made by Microsoft and designed as a video game controller , first introduced in November 2010, was upgraded for the 2013 release of the Xbox One video game console. Kinect's capabilities were revealed in May 2013: an ultra-wide 1080p camera, function in the dark due to an infrared sensor, higher-end processing power and new software, the ability to distinguish between fine movements (such as
4860-439: A network, a BitTorrent download differs from a one way server-client download (as is typical with an HTTP or FTP request, for example) in several fundamental ways: Taken together, these differences allow BitTorrent to achieve much lower cost to the content provider, much higher redundancy, and much greater resistance to abuse or to " flash crowds " than regular server software . However, this protection, theoretically, comes at
5022-587: A new 24/7 cable news channel, MSNBC . Microsoft created Windows CE 1.0 , a new OS designed for devices with low memory and other constraints, such as personal digital assistants . In October 1997, the Justice Department filed a motion in the Federal District Court , stating that Microsoft violated an agreement signed in 1994 and asked the court to stop the bundling of Internet Explorer with Windows. On January 13, 2000, Bill Gates handed over
Llama (language model) - Misplaced Pages Continue
5184-418: A new advanced AI research team. However, the plan was short-lived, as Altman was subsequently reinstated as OpenAI's CEO and Brockman rejoined the company amid pressure from OpenAI's employees and investors on its board. In March 2024, Inflection AI 's cofounders Mustafa Suleyman and Karen Simonyan announced their departure from the company in order to start Microsoft AI, with Microsoft acqui-hiring nearly
5346-491: A new technique based on Rejection sampling was used, followed by PPO. Multi-turn consistency in dialogs was targeted for improvement, to make sure that "system messages" (initial instructions, such as "speak in French" and "act like Napoleon") are respected during the dialog. This was accomplished using the new "Ghost attention" technique during training, which concatenates relevant instructions to each new user message but zeros out
5508-616: A number of "holiday stores" across the U.S. to complement the increasing number of "bricks-and-mortar" Microsoft Stores that opened in 2012. On March 29, 2013, Microsoft launched a Patent Tracker. In August 2012, the New York City Police Department announced a partnership with Microsoft for the development of the Domain Awareness System which is used for Police surveillance in New York City . The Kinect ,
5670-410: A portion if it were to go through. On August 5, 2020, Microsoft stopped its xCloud game streaming test for iOS devices. According to Microsoft, the future of xCloud on iOS remains unclear and potentially out of Microsoft's hands. Apple has imposed a strict limit on " remote desktop clients " which means applications are only allowed to connect to a user-owned host device or gaming console owned by
5832-477: A project named RedPajama to reproduce and distribute an open source version of the LLaMA dataset. The dataset has approximately 1.2 trillion tokens and is publicly available for download. Llama 2 foundational models were trained on a data set with 2 trillion tokens. This data set was curated to remove Web sites that often disclose personal data of people. It also upsamples sources considered trustworthy. Llama 2 - Chat
5994-596: A publishing division named Microsoft Press . Paul Allen resigned from Microsoft in 1983 after developing Hodgkin's lymphoma . Allen claimed in Idea Man: A Memoir by the co-founder of Microsoft that Gates wanted to dilute his share in the company when he was diagnosed with Hodgkin's disease because he did not think that he was working hard enough. Allen later invested in low-tech sectors, sports teams, commercial real estate, neuroscience, private space flight, and more. Microsoft released Windows 1.0 on November 20, 1985, as
6156-497: A re-implementation of LLaMA in C++ , allowing systems without a powerful GPU to run the model locally. The llama.cpp project introduced the GGUF file format, a binary format that stores both tensors and metadata. The format focuses on supporting different quantization types, which can reduce memory usage, and increase speed at the expense of lower model precision. llamafile created by Justine Tunney
6318-452: A record profit in 2007. The European Union imposed another fine of €899 million ($ 1.4 billion) for Microsoft's lack of compliance with the March 2004 judgment on February 27, 2008, saying that the company charged rivals unreasonable prices for key information about its workgroup and backoffice servers. Microsoft stated that it was in compliance and that "these fines are about the past issues that have been resolved". 2007 also saw
6480-443: A rudimentary computer to track and analyze automobile traffic data. Gates enrolled at Harvard University while Allen pursued a degree in computer science at Washington State University , though he later dropped out to work at Honeywell . The January 1975 issue of Popular Electronics featured Micro Instrumentation and Telemetry Systems 's (MITS) Altair 8800 microcomputer, which inspired Allen to suggest that they could program
6642-430: A significant reduction in the original distributor's hardware and bandwidth resource costs. Distributed downloading protocols in general provide redundancy against system problems, reduce dependence on the original distributor, and provide sources for the file which are generally transient and therefore there is no single point of failure as in one way server-client transfers. Though both ultimately transfer files over
Llama (language model) - Misplaced Pages Continue
6804-545: A slightly different approach is provided by the BitComet client through its "Torrent Exchange" feature. Whenever two peers using BitComet (with Torrent Exchange enabled) connect to each other they exchange lists of all the torrents (name and info-hash) they have in the Torrent Share storage (torrent files which were previously downloaded and for which the user chose to enable sharing by Torrent Exchange). Thus each client builds up
6966-406: A system is no longer downloading but only uploading data, and terminate its connection by injecting TCP RST (reset flag) packets. Another unofficial feature is an extension to the BitTorrent metadata format proposed by John Hoffman and implemented by several indexing websites. It allows the use of multiple trackers per file, so if one tracker fails, others can continue to support file transfer. It
7128-426: A third of all internet traffic in 2004, according to a study by Cachelogic. As recently as 2019 BitTorrent remained a significant file sharing protocol according to Sandvine , generating a substantial amount of Internet traffic, with 2.46% of downstream , and 27.58% of upstream traffic, although this share has declined significantly since then. Programmer Bram Cohen , a University at Buffalo alumnus, designed
7290-449: A thumb movement), and determining a user's heart rate by looking at their face. Microsoft filed a patent application in 2011 that suggests that the corporation may use the Kinect camera system to monitor the behavior of television viewers as part of a plan to make the viewing experience more interactive. On July 19, 2013, Microsoft stocks suffered their biggest one-day percentage sell-off since
7452-459: A torrent containing LLaMA's weights was uploaded, with a link to the torrent shared on the 4chan imageboard and subsequently spread through online AI communities. That same day, a pull request on the main LLaMA repository was opened, requesting to add the magnet link to the official documentation. On March 4, a pull request was opened to add links to HuggingFace repositories containing the model. On March 6, Meta filed takedown requests to remove
7614-462: A torrent file could be hosted on one site and tracked by another unrelated site. Private sites operate like public ones except that they may restrict access to registered users and may also keep track of the amount of data each user uploads and downloads, in an attempt to reduce " leeching ". Web search engines allow the discovery of torrent files that are hosted and tracked on other sites; examples include The Pirate Bay and BTDigg . These sites allow
7776-482: A torrent index site. The first uploader acted as a seed , and downloaders would initially connect as peers . Those who wish to download the file would download the torrent, which their client would use to connect to a tracker which had a list of the IP addresses of other seeds and peers in the swarm. Once a peer completed a download of the complete file, it could in turn function as a seed. These files contain metadata about
7938-499: A tracker. Azureus was the first BitTorrent client to implement such a system through the distributed hash table (DHT) method. An alternative and incompatible DHT system, known as Mainline DHT , was released in the Mainline BitTorrent client three weeks later (though it had been in development since 2002) and subsequently adopted by the μTorrent , Transmission , rTorrent , KTorrent , BitComet , and Deluge clients. After
8100-441: A web publisher as creating a direct HTTP download. In addition, it would allow the "web seed" to be disabled if the swarm becomes too popular while still allowing the file to be readily available. This feature has two distinct specifications, both of which are supported by Libtorrent and the 26+ clients that use it. The first was created by John "TheSHAD0W" Hoffman, who created BitTornado. This first specification requires running
8262-399: A web service that serves content by info-hash and piece number, rather than filename. The other specification is created by GetRight authors and can rely on a basic HTTP download space (using byte serving ). In September 2010, a new service named Burnbit was launched which generates a torrent from any URL using webseeding. There are server-side solutions that provide initial seeding of
SECTION 50
#17328589808408424-447: A wide variety of purposes, including for safety research. Open Source Initiative head Stefano Maffulli criticized Meta for describing Llama as open source , saying that it was causing confusion among users and "polluting" the term. BitTorrent BitTorrent , also referred to simply as torrent , is a communication protocol for peer-to-peer file sharing (P2P), which enables users to distribute data and electronic files over
8586-505: Is US$ 500,000 per year. Some analysts deemed this unthinkable ten years prior, however, as in 2001 then-CEO Steve Ballmer called Linux "cancer". Microsoft planned to launch a preview of Intune for Education "in the coming weeks", with general availability scheduled for spring 2017, priced at $ 30 per device, or through volume licensing agreements. In January 2018, Microsoft patched Windows 10 to account for CPU problems related to Intel's Meltdown security breach . The patch led to issues with
8748-486: Is an American multinational technology conglomerate headquartered in Redmond, Washington . Founded in 1975, the company became highly influential in the rise of personal computers through software like Windows , and the company has since expanded to Internet services, cloud computing , video gaming and other fields. Microsoft is the largest software maker , one of the most valuable public U.S. companies, and one of
8910-467: Is an open-source tool that bundles llama.cpp with the model into a single executable file. Tunney et al. introduced new optimized matrix multiplication kernels for x86 and ARM CPUs, improving prompt evaluation performance for FP16 and 8-bit quantized data types. In 2024, researchers from the People's Liberation Army Academy of Military Sciences (top military academy of China ) were reported to have developed
9072-591: Is best known for producing franchises, including but not limited to Warcraft , Diablo , Call of Duty , StarCraft , Candy Crush Saga , Crash Bandicoot , Spyro , Tony Hawk's , Guitar Hero , and Overwatch . Activision and Microsoft each released statements saying the acquisition was to benefit their businesses in the metaverse , many saw Microsoft's acquisition of video game studios as an attempt to compete against Meta Platforms , with TheStreet referring to Microsoft wanting to become "the Disney of
9234-541: Is considered one of the Big Five American information technology companies, alongside Alphabet , Amazon , Apple , and Meta . However it has been criticized for its monopolistic practices and the company's software has been criticized for problems with ease of use , robustness , and security . Childhood friends Bill Gates and Paul Allen sought to make a business using their skills in computer programming . In 1972, they founded Traf-O-Data , which sold
9396-999: Is developing a similar torrent API that will provide the same features, and help bring the torrent community to Web 2.0 standards. Alongside this release is a first PHP application built using the API called PEP, which will parse any Really Simple Syndication (RSS 2.0) feed and automatically create and seed a torrent for each enclosure found in that feed. Since BitTorrent makes up a large proportion of total traffic, some ISPs have chosen to "throttle" (slow down) BitTorrent transfers. For this reason, methods have been developed to disguise BitTorrent traffic in an attempt to thwart these efforts. Protocol header encrypt (PHE) and Message stream encryption/Protocol encryption (MSE/PE) are features of some BitTorrent clients that attempt to make BitTorrent hard to detect and throttle. As of November 2015, Vuze , BitComet , KTorrent , Transmission , Deluge , μTorrent , MooPolice, Halite, qBittorrent , rTorrent , and
9558-478: Is divided into segments called pieces . As each peer receives a new piece of the file, it becomes a source (of that piece) for other peers, relieving the original seed from having to send that piece to every computer or user wishing a copy. With BitTorrent, the task of distributing the file is shared by those who want it; it is entirely possible for the seed to send only a single copy of the file itself and eventually distribute to an unlimited number of peers. Each piece
9720-409: Is implemented in several clients, such as BitComet , BitTornado, BitTorrent, KTorrent , Transmission , Deluge , μTorrent , rtorrent , Vuze , and Frostwire . Trackers are placed in groups, or tiers, with a tracker randomly chosen from the top tier and tried, moving to the next tier if all the trackers in the top tier fail. Torrents with multiple trackers can decrease the time it takes to download
9882-464: Is protected by a cryptographic hash contained in the torrent descriptor. This ensures that any modification of the piece can be reliably detected, and thus prevents both accidental and malicious modifications of any of the pieces received at other nodes. If a node starts with an authentic copy of the torrent descriptor, it can verify the authenticity of the entire file it receives. Pieces are typically downloaded non-sequentially, and are rearranged into
SECTION 60
#173285898084010044-509: The DHT Network and when found it is downloaded by the querying client which can subsequently create and initiate a downloading task. Users find a torrent of interest on a torrent index site or by using a search engine built into the client, download it, and open it with a BitTorrent client. The client connects to the tracker(s) or seeds specified in the torrent file, from which it receives a list of seeds and peers currently transferring pieces of
10206-454: The Department of Justice's Antitrust Division filed a competitive impact statement that said: "Beginning in 1988 and continuing until July 15, 1994, Microsoft induced many OEMs to execute anti-competitive 'per processor licenses. Under a per-processor license, an OEM pays Microsoft a royalty for each computer it sells containing a particular microprocessor, whether the OEM sells the computer with
10368-1000: The IBM PC–compatible operating system market and the office software suite market since the 1990s. Its best-known software products are the Windows line of operating systems , the Microsoft 365 suite of productivity applications, the Azure cloud computing platform, and the Edge web browser. Its flagship hardware products are the Xbox video game consoles and the Microsoft Surface lineup of touchscreen personal computers. Other consumer and enterprise software it produces include Internet search with Bing ; digital services through MSN ; mixed reality through HoloLens ; cloud computing with Azure ; and software development through Visual Studio . Today, Microsoft
10530-480: The Internet in a decentralized manner. The protocol is developed and maintained by Rainberry, Inc. , and was first released in 2001. To send or receive files, users use a BitTorrent client on their Internet-connected computer, which are available for a variety of computing platforms and operating systems , including an official client . BitTorrent trackers provide a list of files available for transfer and allow
10692-580: The Linux operating system. In May 2018, Microsoft partnered with 17 American intelligence agencies to develop cloud computing products. The project is dubbed "Azure Government" and has ties to the Joint Enterprise Defense Infrastructure (JEDI) surveillance program. On June 4, 2018, Microsoft officially announced the acquisition of GitHub for $ 7.5 billion, a deal that closed on October 26, 2018. On July 10, 2018, Microsoft revealed
10854-463: The Microsoft Azure virtual machines reliant on Intel's CPU architecture. On January 12, Microsoft released PowerShell Core 6.0 for the macOS and Linux operating systems. In February 2018, Microsoft killed notification support for their Windows Phone devices which effectively ended firmware updates for the discontinued devices. In March 2018, Microsoft recalled Windows 10 S to change it to
11016-569: The Open Networking Foundation started on March 23, 2011. Fellow founders were Google , HPE Networking , Yahoo! , Verizon Communications , Deutsche Telekom and 17 other companies. This nonprofit organization is focused on providing support for a cloud computing initiative called Software-Defined Networking. The initiative is meant to speed innovation through simple software changes in telecommunications networks, wireless networks, data centers, and other networking areas. Following
11178-613: The Open Source Initiative (known for maintaining the Open Source Definition ). Code Llama is a fine-tune of Llama 2 with code specific datasets. 7B, 13B, and 34B versions were released on August 24, 2023, with the 70B releasing on the January 29, 2024. Starting with the foundation models from Llama 2, Meta AI would train an additional 500B tokens of code datasets, before an additional 20B token of long-context data, creating
11340-506: The Surface Go platform to the public. Later in the month, it converted Microsoft Teams to gratis . In August 2018, Microsoft released two projects called Microsoft AccountGuard and Defending Democracy. It also unveiled Snapdragon 850 compatibility for Windows 10 on the ARM architecture . In August 2018, Toyota Tsusho began a partnership with Microsoft to create fish farming tools using
11502-590: The World Wide Web . With a few exceptions of new companies, like Netscape , Microsoft was the only major and established company that acted fast enough to be a part of the World Wide Web practically from the start. Other companies like Borland , WordPerfect , Novell , IBM and Lotus , being much slower to adapt to the new situation, would give Microsoft market dominance. The company released Windows 95 on August 24, 1995, featuring pre-emptive multitasking ,
11664-489: The Xbox Series X and Xbox Series S video game consoles. In February 2021, Microsoft released Azure Quantum for public preview. The public cloud computing platform provides access to quantum software and quantum hardware including trapped ion , neutral atom , and superconducting systems. In April 2021, Microsoft announced it would buy Nuance Communications for approximately $ 16 billion. The acquisition of Nuance
11826-599: The Yale School of Medicine . It shows increased performance on medical-related benchmarks such as MedQA and MedMCQA. Zoom used Meta Llama 2 to create an AI Companion that can summarize meetings, provide helpful presentation tips, and assist with message responses. This AI Companion is powered by multiple models, including Meta Llama 2. Reuters reported in 2024 that many Chinese foundation models relied on Llama models for their training. Software developer Georgi Gerganov released llama.cpp as open-source on March 10, 2023. It's
11988-492: The internet service provider of users participating in the swarms of files that are under copyright. In some jurisdictions, copyright holders may launch lawsuits against uploaders or downloaders for infringement, and police may arrest suspects in such cases. Various means have been used to promote anonymity. For example, the BitTorrent client Tribler makes available a Tor -like onion network , optionally routing transfers through other peers to obscure which client has requested
12150-516: The most valuable brands globally. Microsoft was founded by Bill Gates and Paul Allen to develop and sell BASIC interpreters for the Altair 8800 . It rose to dominate the personal computer operating system market with MS-DOS in the mid-1980s, followed by Windows. The company's 1986 initial public offering (IPO) and subsequent rise in its share price created three billionaires and an estimated 12,000 millionaires among Microsoft employees. Since
12312-543: The 1990s, it has increasingly diversified from the operating system market. Steve Ballmer replaced Gates as CEO in 2000 which would see the then-largest of Microsoft's corporate acquisitions in Skype Technologies in 2011, and an increased focus on hardware that led to its first in-house PC line, the Surface, in 2012, and the formation of Microsoft Mobile through Nokia . Since Satya Nadella took over as CEO in 2014,
12474-420: The 8B version of Llama 3 was nearly as powerful as the largest Llama 2. Compared to previous models, Zuckerberg stated the team was surprised that the 70B model was still learning even at the end of the 15T tokens training. The decision was made to end training to focus GPU power elsewhere. Llama-3.1 was released on July 23, 2024, with three sizes: 8B, 70B, and 405B parameters. For the training cost column, only
12636-501: The Azureus/Vuze client to reach a bigger swarm. Another idea that has surfaced in Vuze is that of virtual torrents . This idea is based on the distributed tracker approach and is used to describe some web resource. Currently, it is used for instant messaging . It is implemented using a special messaging protocol and requires an appropriate plugin. Anatomic P2P is another approach, which uses
12798-403: The BitTorrent protocol, several basic computers, such as home computers, can replace large servers while efficiently distributing files to many recipients. This lower bandwidth usage also helps prevent large spikes in internet traffic in a given area, keeping internet speeds higher for all users in general, regardless of whether or not they use the BitTorrent protocol. The file being distributed
12960-404: The BitTorrent v2 protocol specification. BitTorrent v2 is intended to work seamlessly with previous versions of the BitTorrent protocol. The main reason for the update was that the old cryptographic hash function , SHA-1 , is no longer considered safe from malicious attacks by the developers, and as such, v2 uses SHA-256 . To ensure backwards compatibility, the v2 .torrent file format supports
13122-557: The CEO position to Steve Ballmer , an old college friend of Gates and employee of the company since 1980, while creating a new position for himself as Chief Software Architect . Various companies including Microsoft formed the Trusted Computing Platform Alliance in October 1999 to (among other things) increase security and protect intellectual property through identifying changes in hardware and software. Critics decried
13284-537: The Code Llama foundation models. This foundation model was further trained on 5B instruction following token to create the instruct fine-tune. Another foundation model was created for Python code, which trained on 100B tokens of Python-only code, before the long-context data. On April 18, 2024, Meta released Llama-3 with two sizes: 8B and 70B parameters. The models have been pre-trained on approximately 15 trillion tokens of text gathered from “publicly available sources” with
13446-519: The DHT was adopted, a "private" flag – analogous to the broadcast flag – was unofficially introduced, telling clients to restrict the use of decentralized tracking regardless of the user's desires. The flag is intentionally placed in the info section of the torrent so that it cannot be disabled or removed without changing the identity of the torrent. The purpose of this DRM is to prevent torrents from being shared with clients that do not have access to
13608-648: The Federal Trade Commission examined Microsoft for possible collusion due to the partnership with IBM, marking the beginning of more than a decade of legal clashes with the government. Meanwhile, the company was at work on Microsoft Windows NT , which was heavily based on their copy of the OS/2 code. It shipped on July 21, 1993, with a new modular kernel and the 32-bit Win32 application programming interface (API), making it easier to port from 16-bit (MS-DOS-based) Windows. Microsoft informed IBM of Windows NT, and
13770-455: The HuggingFace repositories linked in the pull request, characterizing it as "unauthorized distribution" of the model. HuggingFace complied with the requests. On March 20, Meta filed a DMCA takedown request for copyright infringement against a repository containing a script that downloaded LLaMA from a mirror, and GitHub complied the next day. Reactions to the leak varied. Some speculated that
13932-527: The Llama series was the scaling laws . It was observed that the Llama 3 models showed that when a model is trained on data that is more than the " Chinchilla -optimal" amount, the performance continues to scale log-linearly. For example, the Chinchilla-optimal dataset for Llama 3 8B is 200 billion tokens, but performance continued to scale log-linearly to the 75-times larger dataset of 15 trillion tokens. LLaMA
14094-534: The Magic Unicorn Corporation. ___ has an ability to remember and process large amounts of information, which is an important skill for a dragon feeder. ___, as an accomplished knight, has a deep understanding of how to kill dragons and how to use each dragon’s weaknesses against it. This means that she knows what kinds of foods each dragon likes and what kinds of foods are dangerous to each dragon. This knowledge and experience will be invaluable as she feeds
14256-477: The Microsoft Azure application suite for Internet of things (IoT) technologies related to water management. Developed in part by researchers from Kindai University , the water pump mechanisms use artificial intelligence to count the number of fish on a conveyor belt , analyze the number of fish, and deduce the effectiveness of water flow from the data the fish provide. The specific computer programs used in
14418-542: The OS/2 partnership deteriorated. In 1990, Microsoft introduced the Microsoft Office suite which bundled separate applications such as Microsoft Word and Microsoft Excel . On May 22, Microsoft launched Windows 3.0 , featuring streamlined user interface graphics and improved protected mode capability for the Intel 386 processor, and both Office and Windows became dominant in their respective areas. On July 27, 1994,
14580-793: The Q4 2023 Earnings transcript, Meta adopted the strategy of open weights to improve on model safety, iteration speed, increase adoption among developers and researchers, and to become the industry standard. Llama 5, 6, and 7 are planned for the future. The release of Llama models has sparked significant debates on the benefits and misuse risks of open weight models. Such models can be fine-tuned to remove safeguards, notably by cyber criminals, until they comply with harmful requests. Some experts contend that future models may facilitate causing damage more than defending against it, for example by making it relatively easy to engineer advanced bioweapons without specialized knowledge. Conversely, open-weight models can be useful for
14742-480: The U.S. smartphone market in January 2016 was 2.7%. During the summer of 2015 the company lost $ 7.6 billion related to its mobile-phone business, firing 7,800 employees. In 2015, the construction of a data center in Mecklenburg County , Virginia led to the destruction of a historic African American cemetery despite archeological recommendations for preservation. On March 1, 2016, Microsoft announced
14904-462: The United States. That year the company also launched the Surface "digital table", later renamed PixelSense . Released in January 2007, the next version of Windows, Vista , focused on features, security and a redesigned user interface dubbed Aero . Microsoft Office 2007 , released at the same time, featured a " Ribbon " user interface which was a significant departure from its predecessors. Relatively strong sales of both products helped to produce
15066-468: The ability of BitTorrent clients to download torrent pieces from an HTTP source in addition to the "swarm". The advantage of this feature is that a website may distribute a torrent for a particular file or batch of files and make those files available for download from that same web server; this can simplify long-term seeding and load balancing through the use of existing, cheap, web hosting setups. In theory, this would make using BitTorrent almost as easy for
15228-484: The ability to detect, decide and engage before the enemy." In November 2018, Microsoft introduced Azure Multi-Factor Authentication for Microsoft Azure. In December 2018, Microsoft announced Project Mu , an open source release of the Unified Extensible Firmware Interface (UEFI) core used in Microsoft Surface and Hyper-V products. The project promotes the idea of Firmware as a Service . In
15390-400: The alliance as a way to enforce indiscriminate restrictions over how consumers use software, and over how computers behave, and as a form of digital rights management : for example, the scenario where a computer is not only secured for its owner but also secured against its owner as well. On April 3, 2000, a judgment was handed down in the case of United States v. Microsoft Corp. , calling
15552-679: The authorization of copyright holders, rendering those sites especially vulnerable to lawsuits. A BitTorrent index is a "list of .torrent files , which typically includes descriptions" and information about the torrent's content. Several types of websites support the discovery and distribution of data on the BitTorrent network. Public torrent-hosting sites such as The Pirate Bay allow users to search and download from their collection of torrent files. Users can typically also upload torrent files for content they wish to distribute. Often, these sites also run BitTorrent trackers for their hosted torrent files, but these two functions are not mutually dependent:
15714-461: The beginning, BitTorrent's non-contiguous download methods made it harder to support "streaming playback". In 2014, the client Popcorn Time allowed for streaming of BitTorrent video files. Since then, more and more clients are offering streaming options. The BitTorrent protocol provides no way to index torrent files. As a result, a comparatively small number of websites have hosted a large majority of torrents, many linking to copyrighted works without
15876-434: The client to find peer users, known as "seeds", who may transfer the files. BitTorrent downloading is considered to be faster than HTTP ("direct downloading") and FTP due to the lack of a central server that could limit bandwidth. BitTorrent is one of the most common protocols for transferring large files, such as digital video files containing TV shows and video clips, or digital audio files. BitTorrent accounted for
16038-482: The company , citing it abused its dominance with the Windows OS, resulting in a judgment of €497 million ($ 613 million) and requiring Microsoft to produce new versions of Windows XP without Windows Media Player : Windows XP Home Edition N and Windows XP Professional N. In November 2005, the company's second video game console, the Xbox 360 , was released. There were two versions, a basic version for $ 299.99 and
16200-531: The company an "abusive monopoly." Microsoft later settled with the U.S. Department of Justice in 2004. On October 25, 2001, Microsoft released Windows XP , unifying the mainstream and NT lines of OS under the NT codebase. The company released the Xbox later that year, entering the video game console market dominated by Sony and Nintendo . In March 2004 the European Union brought antitrust legal action against
16362-593: The company announced it was laying off 1,850 workers, and taking an impairment and restructuring charge of $ 950 million. In June 2016, Microsoft announced a project named Microsoft Azure Information Protection. It aims to help enterprises protect their data as it moves between servers and devices. In November 2016, Microsoft joined the Linux Foundation as a Platinum member during Microsoft's Connect(); developer event in New York. The cost of each Platinum membership
16524-605: The company has changed focus towards cloud computing , as well as its large acquisition of LinkedIn for $ 26.2 billion in 2016. Under Nadella's direction, the company has also expanded its video gaming business to support the Xbox brand, establishing the Microsoft Gaming division in 2022, which is currently the third-largest gaming company in the world by revenue, following the 2023 acquisition of Activision Blizzard for $ 68.7 billion. Microsoft has been market-dominant in
16686-620: The company's war profiteering from a $ 480 million contract to develop virtual reality headsets for the United States Army . On March 26, 2020, Microsoft announced it was acquiring Affirmed Networks for about $ 1.35 billion. Due to the COVID-19 pandemic , Microsoft closed all of its retail stores indefinitely due to health concerns. On July 22, 2020, Microsoft announced plans to close its Mixer service, planning to move existing partners to Facebook Gaming . On July 31, 2020, it
16848-460: The concept of minimalism. Microsoft implemented a new strategy for the software industry, providing a consistent user experience across all smartphones using the Windows Phone OS. It launched an alliance with Nokia in 2011 and Microsoft worked closely with the company to co-develop Windows Phone, but remained partners with long-time Windows Mobile OEM HTC . Microsoft is a founding member of
17010-406: The correct order by the BitTorrent client, which monitors which pieces it needs, and which pieces it has and can upload to other peers. Pieces are of the same size throughout a single download (for example, a 10 MB file may be transmitted as ten 1 MB pieces or as forty 256 KB pieces). Due to the nature of this approach, the download of any file can be halted at any time and be resumed at
17172-575: The creation of a multi-core unit at Microsoft, following the steps of server companies such as Sun and IBM. Gates retired from his role as Chief Software Architect on June 27, 2008, a decision announced in June 2006, while retaining other positions related to the company in addition to being an advisor for the company on key projects. Azure Services Platform , the company's entry into the cloud computing market for Windows, launched on October 27, 2008. On February 12, 2009, Microsoft announced its intent to open
17334-582: The data. The exit node would be visible to peers in a swarm, but the Tribler organization provides exit nodes. One advantage of Tribler is that clearnet torrents can be downloaded with only a small decrease in download speed from one "hop" of routing. i2p provides a similar anonymity layer although in that case, one can only download torrents that have been uploaded to the i2p network. The bittorrent client Vuze allows users who are not concerned about anonymity to take clearnet torrents, and make them available on
17496-467: The download taste of the user, and recommend additional content. In May 2007, researchers at Cornell University published a paper proposing a new approach to searching a peer-to-peer network for inexact strings, which could replace the functionality of a central indexing site. A year later, the same team implemented the system as a plugin for Vuze called Cubit and published a follow-up paper reporting its success. A somewhat similar facility but with
17658-529: The dragons. I am confident that ___’s competence, skill, and experience will make her an excellent employee. Please contact me at (___) ___-___ if you have any questions. I look forward to hearing from you. Best regards, Honorable Knight Sir George – Output of 65 billion parameter LLaMA model before instruction tuning , given the prompt (in bold) Like GPT-3, the Llama series of models are decoder-only Transformers , but there are some minor differences: LLaMA's developers focused their effort on scaling
17820-424: The efficiency of the protocol. When another peer later receives a particular piece, the hash of the piece is compared to the recorded hash to test that the piece is error-free. Peers that provide a complete file are called seeders, and the peer providing the initial copy is called the initial seeder. The exact information contained in the torrent file depends on the version of the BitTorrent protocol. By convention,
17982-505: The feed for new items, and use them to start the download. Then, I could find a trusted publisher of an Alias RSS feed, and "subscribe" to all new episodes of the show, which would then start downloading automatically – like the "season pass" feature of the TiVo . The RSS feed will track the content, while BitTorrent ensures content integrity with cryptographic hashing of all data, so feed subscribers will receive uncorrupted content. One of
18144-727: The file from the web server via standard BitTorrent protocol and when the number of external seeders reach a limit, they stop serving the file from the original source. A technique called broadcatching combines RSS feeds with the BitTorrent protocol to create a content delivery system, further simplifying and automating content distribution. Steve Gillmor explained the concept in a column for Ziff-Davis in December 2003. The discussion spread quickly among bloggers (Ernest Miller, Chris Pirillo , etc.). In an article entitled Broadcatching with BitTorrent , Scott Raymond explained: I want RSS feeds of BitTorrent files. A script would periodically check
18306-734: The file(s). The client connects to those peers to obtain the various pieces. If the swarm contains only the initial seeder, the client connects directly to it, and begins to request pieces. Clients incorporate mechanisms to optimize their download and upload rates. The effectiveness of this data exchange depends largely on the policies that clients use to determine to whom to send data. Clients may prefer to send data to peers that send data back to them (a " tit for tat " exchange scheme), which encourages fair trading. But strict policies often result in suboptimal situations, such as when newly joined peers are unable to receive any data because they do not have any pieces yet to trade themselves or when two peers with
18468-460: The files to be shared and the trackers which keep track of the other seeds and peers. In 2005, first Vuze and then the BitTorrent client introduced distributed tracking using distributed hash tables which allowed clients to exchange data on swarms directly without the need for a torrent file. In 2006, peer exchange functionality was added allowing clients to add peers based on the data found on connected nodes. In 2017, BitTorrent, Inc. released
18630-445: The first and popular software clients ( free and open source ) for broadcatching is Miro . Other free software clients such as PenguinTV and KatchTV are also now supporting broadcatching. The BitTorrent web-service MoveDigital added the ability to make torrents available to any web application capable of parsing XML through its standard REST -based interface in 2006, though this has since been discontinued. Additionally, Torrenthut
18792-459: The foundational models. The accompanying preprint also mentions a model with 34B parameters that might be released in the future upon satisfying safety targets. Llama 2 includes foundation models and models fine-tuned for chat. In a further departure from LLaMA, all models are released with weights and are free for many commercial use cases. However, due to some remaining restrictions, Meta's description of LLaMA as open source has been disputed by
18954-577: The goals of publishers that value BitTorrent as a cheap alternative to a client-server approach. This occurs on a huge scale; measurements have shown that 38% of all new torrents become unavailable within the first month. A strategy adopted by many publishers which significantly increases availability of unpopular content consists of bundling multiple files in a single swarm. More sophisticated solutions have also been proposed; generally, these use cross-torrent mechanisms through which multiple torrents can cooperate to better share content. The peer distributing
19116-494: The i2p network. Most BitTorrent clients are not designed to provide anonymity when used over Tor, and there is some debate as to whether torrenting over Tor acts as a drag on the network. "Private" torrent websites are usually invitation only, and require members to participate in uploading, but have the downside of a single centralized point of failure. Oink's Pink Palace and What.cd are examples of private torrent sites which have been shut down. Seedbox services download
19278-507: The instruct models fine-tuned on “publicly available instruction datasets, as well as over 10M human-annotated examples". Meta AI's testing showed in April 2024 that Llama 3 70B was beating Gemini pro 1.5 and Claude 3 Sonnet on most benchmarks. Meta also announced plans to make Llama 3 multilingual and multimodal , better at coding and reasoning, and to increase its context window. During an interview with Dwarkesh Patel, Mark Zuckerberg said that
19440-443: The intention of shaping traffic in a protocol-agnostic manner. Questions about the ethics and legality of Comcast's behavior have led to renewed debate about net neutrality in the United States . In general, although encryption can make it difficult to determine what is being shared, BitTorrent is vulnerable to traffic analysis . Thus, even with MSE/PE, it may be possible for an ISP to recognize BitTorrent and also to determine that
19602-552: The largest model's cost is written. So for example, "21,000" is the training cost of Llama 2 69B in units of petaFLOP-day. Also, 1 petaFLOP-day = 1 petaFLOP/sec × 1 day = 8.64E19 FLOP. "T" means "trillion" and "B" means "billion". Here is the recommendation letter that I wrote for an application to a dragon feeder position at the Magic Unicorn Corporation: Dear recruiter, I have known ___ for two years, and I believe that she would be an excellent dragon feeder for
19764-440: The last version of the operating system; set to be released in the third quarter of 2021. It was released to the general public on October 5, 2021. In September 2021, it was announced that the company had acquired Takelessons, an online platform that connects students and tutors in numerous subjects. The acquisition positioned Microsoft to grow its presence in the market of providing online education to large numbers of people. In
19926-466: The latest official BitTorrent client (v6) support MSE/PE encryption. In August 2007, Comcast was preventing BitTorrent seeding by monitoring and interfering with the communication between peers. Protection against these efforts is provided by proxying the client-tracker traffic via an encrypted tunnel to a point outside of the Comcast network. In 2008, Comcast called a "truce" with BitTorrent, Inc. with
20088-477: The loss function for tokens in the prompt (earlier parts of the dialog). The Stanford University Institute for Human-Centered Artificial Intelligence (HAI) Center for Research on Foundation Models (CRFM) released Alpaca, a training recipe based on the LLaMA 7B model that uses the "Self-Instruct" method of instruction tuning to acquire capabilities comparable to the OpenAI GPT-3 series text-davinci-003 model at
20250-517: The merger of its PC and Xbox divisions, with Phil Spencer announcing that Universal Windows Platform (UWP) apps would be the focus for Microsoft's gaming in the future. On January 24, 2017, Microsoft showcased Intune for Education at the BETT 2017 education technology conference in London . Intune for Education is a new cloud-based application and device management service for the education sector. In May 2016,
20412-487: The metaverse". Microsoft also named Phil Spencer , head of the Xbox brand since 2014, the inaugural CEO of the newly established Microsoft Gaming division, which now houses the Xbox operations team and the three publishers in the company's portfolio (Xbox Game Studios, ZeniMax Media, Activision Blizzard). Microsoft has not released statements regarding Activision's recent legal controversies regarding employee abuse, but reports have alleged that Activision CEO Bobby Kotick ,
20574-479: The model would be used for malicious purposes, such as more sophisticated spam . Some have celebrated the model's accessibility, as well as the fact that smaller versions of the model can be run relatively cheaply, suggesting that this will promote the flourishing of additional research developments. Multiple commentators, such as Simon Willison , compared LLaMA to Stable Diffusion , a text-to-image model which, unlike comparably sophisticated models which preceded it,
20736-434: The model's performance by increasing the volume of training data, rather than the number of parameters, reasoning that the dominating cost for LLMs is from doing inference on the trained model rather than the computational cost of the training process. LLaMA 1 foundational models were trained on a data set with 1.4 trillion tokens, drawn from publicly available data sources, including: On April 17, 2023, TogetherAI launched
20898-448: The name "Micro-Soft", short for micro-computer software. In August 1977, the company formed an agreement with ASCII Magazine in Japan, resulting in its first international office of ASCII Microsoft . Microsoft moved its headquarters to Bellevue, Washington , in January 1979. Microsoft entered the operating system (OS) business in 1980 with its own version of Unix called Xenix , but it
21060-595: The name of a torrent file has the suffix .torrent . Torrent files use the Bencode file format, and contain an "announce" section, which specifies the URL of the tracker, and an "info" section, containing (suggested) names for the files, their lengths, the piece length used, and a SHA-1 hash code for each piece, all of which are used by clients to verify the integrity of the data they receive. Though SHA-1 has shown signs of cryptographic weakness, Bram Cohen did not initially consider
21222-408: The overall "health" of the file (as determined by the number of times a file is available in its complete form). The distributed nature of BitTorrent can lead to a flood-like spreading of a file throughout many peer computer nodes. As more peers join the swarm, the likelihood of a successful download by any particular node increases. Relative to traditional Internet distribution schemes, this permits
21384-665: The process fall under the Azure Machine Learning and the Azure IoT Hub platforms. In September 2018, Microsoft discontinued Skype Classic . On October 10, 2018, Microsoft joined the Open Invention Network community despite holding more than 60,000 patents. In November 2018, Microsoft agreed to supply 100,000 Microsoft HoloLens headsets to the United States military in order to "increase lethality by enhancing
21546-473: The protocol in April 2001, and released the first available version on 2 July 2001. Cohen and Ashwin Navin founded BitTorrent, Inc. (later renamed Rainberry, Inc. ) to further develop the technology in 2004. The first release of the BitTorrent client had no search engine and no peer exchange. Up until 2005, the only way to share files was by creating a small text file called a " torrent ", that they would upload to
21708-513: The release of Windows Phone , Microsoft undertook a gradual rebranding of its product range throughout 2011 and 2012, with the corporation's logos, products, services, and websites adopting the principles and concepts of the Metro design language . Microsoft unveiled Windows 8 , an operating system designed to power both personal computers and tablet computers , in Taipei in June 2011. A developer preview
21870-623: The release of the IBM PC in August 1981. IBM had copyrighted the IBM PC BIOS , so other companies had to reverse engineer it for non-IBM hardware to run as IBM PC compatibles , but no such restriction applied to the operating systems. Microsoft eventually became the leading PC operating systems vendor. The company expanded into new markets with the release of the Microsoft Mouse in 1983, as well as with
22032-441: The risk big enough for a backward incompatible change to, for example, SHA-3 . As of BitTorrent v2 the hash function has been updated to SHA-256. In the early days, torrent files were typically published to torrent index websites, and registered with at least one tracker. The tracker maintained lists of the clients currently connected to the swarm. Alternatively, in a trackerless system (decentralized tracking) every peer acts as
22194-507: The role of CFO. On February 4, 2014, Steve Ballmer stepped down as CEO of Microsoft and was succeeded by Satya Nadella , who previously led Microsoft's Cloud and Enterprise division. On the same day, John W. Thompson took on the role of chairman, in place of Bill Gates, who continued to participate as a technology advisor. Thompson became the second chairman in Microsoft's history. On April 25, 2014, Microsoft acquired Nokia Devices and Services for $ 7.2 billion. This new subsidiary
22356-407: The same month, Microsoft acquired Australia-based video editing software company Clipchamp . In October 2021, Microsoft announced that it began rolling out end-to-end encryption (E2EE) support for Microsoft Teams calls in order to secure business communication while using video conferencing software. Users can ensure that their calls are encrypted and can utilize a security code that both parties on
22518-903: The same month, Microsoft announced the open source implementation of Windows Forms and the Windows Presentation Foundation (WPF) which will allow for further movement of the company toward the transparent release of key frameworks used in developing Windows desktop applications and software. December also saw the company discontinue the Microsoft Edge project in favor of Chromium backends for their browsers. On February 20, 2019, Microsoft Corp said it will offer its cyber security service AccountGuard to 12 new markets in Europe including Germany, France and Spain, to close security gaps and protect customers in political space from hacking. In February 2019, hundreds of Microsoft employees protested
22680-479: The swarm to be deduplicated, so that if multiple torrents include the same files, but seeders are only seeding the file from some, downloaders of the other torrents can still download the file. In addition, file hashes can be displayed on tracker, torrent indexing services, to search for swarms by searching for hashes of files contained in them. These hashes are different from the usual SHA-256 hash of files and can be obtained using tools. Magnet links for v2 also support
22842-464: The team finished the Web browser, and instead were included in the Windows 95 Plus! pack. Backed by a high-profile marketing campaign and what The New York Times called "the splashiest, most frenzied, most expensive introduction of a computer product in the industry's history," Windows 95 quickly became a success. Branching out into new markets in 1996, Microsoft and General Electric 's NBC unit created
23004-471: The torrent files first to the company's servers, allowing the user to direct download the file from there. One's IP address would be visible to the Seedbox provider, but not to third parties. Virtual private networks encrypt transfers, and substitute a different IP address for the user's, so that anyone monitoring a torrent swarm will only see that address. On 2 May 2005, Azureus 2.3.0.0 (now known as Vuze )
23166-590: The tracker. The flag was requested for inclusion in the official specification in August 2008, but has not been accepted yet. Clients that have ignored the private flag were banned by many trackers, discouraging the practice. BitTorrent does not, on its own, offer its users anonymity. One can usually see the IP addresses of all peers in a swarm in one's own client or firewall program. This may expose users with insecure systems to attacks. In some countries, copyright organizations scrape lists of peers, and send takedown notices to
23328-547: The user to ask for content meeting specific criteria (such as containing a given word or phrase) and retrieve a list of links to torrent files matching those criteria. This list can often be sorted with respect to several criteria, relevance (seeders to leechers ratio) being one of the most popular and useful (due to the way the protocol behaves, the download bandwidth achievable is very sensitive to this value). Metasearch engines allow one to search several BitTorrent indices and search engines at once. The Tribler BitTorrent client
23490-407: The user. On September 21, 2020, Microsoft announced its intent to acquire video game company ZeniMax Media , the parent company of Bethesda Softworks , for about $ 7.5 billion, with the deal expected to occur in the second half of 2021 fiscal year. On March 9, 2021, the acquisition was finalized and ZeniMax Media became part of Microsoft's Xbox Game Studios division. The total price of the deal
23652-449: The world". Llama was trained on only publicly available information, and was trained at various model sizes, with the intention to make it more accessible to different hardware. Meta AI reported the 13B parameter model performance on most NLP benchmarks exceeded that of the much larger GPT-3 (with 175B parameters), and the largest 65B model was competitive with state of the art models such as PaLM and Chinchilla . On March 3, 2023,
23814-654: The year 2000, after its fourth-quarter report raised concerns among investors on the poor showings of both Windows 8 and the Surface tablet. Microsoft suffered a loss of more than US$ 32 billion. In line with the maturing PC business, in July 2013, Microsoft announced that it would reorganize the business into four new business divisions, namely Operating systems, Apps, Cloud, and Devices. All previous divisions will be dissolved into new divisions without any workforce cuts. On September 3, 2013, Microsoft agreed to buy Nokia 's mobile unit for $ 7 billion, following Amy Hood taking
23976-528: Was MS-DOS that solidified the company's dominance. IBM awarded a contract to Microsoft in November 1980 to provide a version of the CP/M OS to be used in the IBM Personal Computer (IBM PC). For this deal, Microsoft purchased a CP/M clone called 86-DOS from Seattle Computer Products which it branded as MS-DOS, although IBM rebranded it to IBM PC DOS . Microsoft retained ownership of MS-DOS following
24138-438: Was $ 8.1 billion. On September 22, 2020, Microsoft announced that it had an exclusive license to use OpenAI 's GPT-3 artificial intelligence language generator. The previous version of GPT-3 , called GPT-2 , made headlines for being "too dangerous to release" and had numerous capabilities, including designing websites, prescribing medication, answering questions, and penning articles. On November 10, 2020, Microsoft released
24300-457: Was 64. For AI alignment , human annotators wrote prompts and then compared two model outputs (a binary protocol), giving confidence levels and separate safety labels with veto power. Two separate reward models were trained from these preferences for safety and helpfulness using Reinforcement learning from human feedback (RLHF). A major technical contribution is the departure from the exclusive use of Proximal Policy Optimization (PPO) for RLHF –
24462-643: Was additionally fine-tuned on 27,540 prompt-response pairs created for this project, which performed better than larger but lower-quality third-party datasets. For AI alignment, reinforcement learning with human feedback (RLHF) was used with a combination of 1,418,091 Meta examples and seven smaller datasets. The average dialog depth was 3.9 in the Meta examples, 3.0 for Anthropic Helpful and Anthropic Harmless sets, and 1.0 for five other sets, including OpenAI Summarize, StackExchange, etc. Llama 3 consists of mainly English data, with over 5% in over 30 other languages. Its dataset
24624-427: Was among the first to incorporate built-in search capabilities. With Tribler, users can find .torrent files held by random peers and taste buddies. It adds such an ability to the BitTorrent protocol using a gossip protocol , somewhat similar to the eXeem network which was shut down in 2005. The software includes the ability to recommend content as well. After a dozen downloads, the Tribler software can roughly estimate
24786-498: Was announced on February 24, 2023, via a blog post and a paper describing the model's training , architecture, and performance. The inference code used to run the model was publicly released under the open-source GPLv3 license. Access to the model's weights was managed by an application process, with access to be granted "on a case-by-case basis to academic researchers; those affiliated with organizations in government, civil society, and academia; and industry research laboratories around
24948-468: Was completed in March 2022. In 2021, in part due to the strong quarterly earnings spurred by the COVID-19 pandemic , Microsoft's valuation came to nearly $ 2 trillion. The increased necessity for remote work and distance education drove demand for cloud computing and grew the company's gaming sales. On June 24, 2021, Microsoft announced Windows 11 during a Livestream. The announcement came with confusion after Microsoft announced Windows 10 would be
25110-546: Was filtered by a text-quality classifier, and the classifier was trained by text synthesized by Llama 2. Llama 1 models are only available as foundational models with self-supervised learning and without fine-tuning. Llama 2 – Chat models were derived from foundational Llama 2 models. Unlike GPT-4 which increased context length during fine-tuning, Llama 2 and Code Llama - Chat have the same context length of 4K tokens. Supervised fine-tuning used an autoregressive loss function with token loss on user prompts zeroed out. The batch size
25272-402: Was only available as a foundation model . Starting with Llama 2, Meta AI started releasing instruction fine-tuned versions alongside foundation models. Alongside the release of Llama 3, Meta added virtual assistant features to Facebook and WhatsApp in select regions, and a standalone website. Both services use a Llama 3 model. After the release of large language models such as GPT-3 ,
25434-414: Was openly distributed, leading to a rapid proliferation of associated tools, techniques, and software. On July 18, 2023, in partnership with Microsoft , Meta announced Llama 2, the next generation of Llama. Meta trained and released Llama 2 in three model sizes: 7, 13, and 70 billion parameters. The model architecture remains largely unchanged from that of LLaMA-1 models, but 40% more data was used to train
25596-684: Was released on September 13, which was subsequently replaced by a consumer preview on February 29, 2012, and released to the public in May. The Surface was unveiled on June 18, becoming the first computer in the company's history to have its hardware made by Microsoft. On June 25, Microsoft paid US$ 1.2 billion to buy the social network Yammer . On July 31, they launched the Outlook.com webmail service to compete with Gmail . On September 4, 2012, Microsoft released Windows Server 2012 . In July 2012, Microsoft sold its 50% stake in MSNBC, which it had run as
25758-437: Was released, utilizing a distributed database system. This system is a distributed hash table implementation which allows the client to use torrents that do not have a working BitTorrent tracker . A bootstrap server is instead utilized. The following month, BitTorrent, Inc. released version 4.2.0 of the Mainline BitTorrent client, which supported an alternative DHT implementation (popularly known as " Mainline DHT ", outlined in
25920-587: Was released, with its server sibling, Windows Server 2016 , released in September 2016. In Q1 2015, Microsoft was the third-largest maker of mobile phones , selling 33 million units (7.2% of all). While a large majority (at least 75%) of them do not run any version of Windows Phone — those other phones are not categorized as smartphones by Gartner – in the same timeframe 8 million Windows smartphones (2.5% of all smartphones) were made by all manufacturers (mostly Microsoft). Microsoft's share of
26082-425: Was renamed Microsoft Mobile Oy. On September 15, 2014, Microsoft acquired the video game development company Mojang , best known for Minecraft , for $ 2.5 billion. On June 8, 2017, Microsoft acquired Hexadite , an Israeli security firm, for $ 100 million. On January 21, 2015, Microsoft announced the release of their first Interactive whiteboard , Microsoft Surface Hub . On July 29, 2015, Windows 10
26244-571: Was reported that Microsoft was in talks to acquire TikTok after the Trump administration ordered ByteDance to divest ownership of the application to the U.S. On August 3, 2020, after speculation on the deal, Donald Trump stated that Microsoft could buy the application, however, it should be completed by September 15, 2020, and that the United States Department of the Treasury should receive
#839160