<?xml version="1.0"?>
<feed xmlns="http://www.w3.org/2005/Atom" xml:lang="en">
	<id>https://wiki-planet.win/api.php?action=feedcontributions&amp;feedformat=atom&amp;user=Carinekmin</id>
	<title>Wiki Planet - User contributions [en]</title>
	<link rel="self" type="application/atom+xml" href="https://wiki-planet.win/api.php?action=feedcontributions&amp;feedformat=atom&amp;user=Carinekmin"/>
	<link rel="alternate" type="text/html" href="https://wiki-planet.win/index.php/Special:Contributions/Carinekmin"/>
	<updated>2026-06-01T21:29:55Z</updated>
	<subtitle>User contributions</subtitle>
	<generator>MediaWiki 1.42.3</generator>
	<entry>
		<id>https://wiki-planet.win/index.php?title=Why_What_Clients_Need_from_Event_Companies_in_Kuala_Lumpur_for_Large_Language_Models_Matters&amp;diff=2008384</id>
		<title>Why What Clients Need from Event Companies in Kuala Lumpur for Large Language Models Matters</title>
		<link rel="alternate" type="text/html" href="https://wiki-planet.win/index.php?title=Why_What_Clients_Need_from_Event_Companies_in_Kuala_Lumpur_for_Large_Language_Models_Matters&amp;diff=2008384"/>
		<updated>2026-05-28T20:42:21Z</updated>

		<summary type="html">&lt;p&gt;Carinekmin: Created page with &amp;quot;&amp;lt;html&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; Large Language Models are not small transformer models. GPT-2 has 1.5 billion parameters at its largest. GPT-3 has 175 billion parameters. LLMs require specialized infrastructure. An LLM event is not a standard NLP conference. It should handle parameter scaling, latency reduction, instruction design, external data connection, and responsible deployment strategies.&amp;lt;/p&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; Businesses assessing coordi...&amp;quot;&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&amp;lt;html&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; Large Language Models are not small transformer models. GPT-2 has 1.5 billion parameters at its largest. GPT-3 has 175 billion parameters. LLMs require specialized infrastructure. An LLM event is not a standard NLP conference. It should handle parameter scaling, latency reduction, instruction design, external data connection, and responsible deployment strategies.&amp;lt;/p&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; Businesses assessing coordinators in Klang Valley for large language model events|for LLM summits|for foundation model gatherings need specific technical capabilities|must address particular infrastructure requirements|should cover deployment and optimization strategies.&amp;lt;/p&amp;gt;&amp;lt;h2&amp;gt;  Inference Infrastructure: Serving Billions of Parameters&amp;lt;/h2&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; 175 billion parameters require at least 350GB at half precision. Pipeline parallelism distributes transformer blocks.&amp;lt;/p&amp;gt;&amp;lt;p&amp;gt; &amp;lt;img  src=&amp;quot;https://i.ytimg.com/vi/J-kKR3omk-g/hq720.jpg&amp;quot; style=&amp;quot;max-width:500px;height:auto;&amp;quot; &amp;gt;&amp;lt;/img&amp;gt;&amp;lt;/p&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; A coordinator from Kollysphere agency shared: “A vendor claimed an LLM demo. They used GPT-2. &#039;That is not an LLM,&#039; I said. &#039;GPT-2 has 1.5 billion parameters maximum. Modern LLMs are 100 times larger.&#039; &#039;We can scale up,&#039; they said. &#039;Do you have multi-GPU infrastructure?&#039; I asked. They did not. They were using a small model and calling it large. Now we verify model size and infrastructure in every LLM event.”&amp;lt;/p&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; Ask event companies in Kuala Lumpur: What hardware infrastructure do you use for inference (GPU type, count, memory).&amp;lt;/p&amp;gt;&amp;lt;h2&amp;gt;  Latency and Throughput: Generation Speed Matters&amp;lt;/h2&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; Generating 100 tokens can take seconds. Latency affects user experience and interactivity. Throughput is the number of tokens per second.&amp;lt;/p&amp;gt;&amp;lt;p&amp;gt; &amp;lt;iframe  src=&amp;quot;https://www.youtube.com/embed/Rqa60NXCPao&amp;quot; width=&amp;quot;560&amp;quot; height=&amp;quot;315&amp;quot; style=&amp;quot;border: none;&amp;quot; allowfullscreen=&amp;quot;&amp;quot; &amp;gt;&amp;lt;/iframe&amp;gt;&amp;lt;/p&amp;gt;&amp;lt;p&amp;gt; &amp;lt;iframe  src=&amp;quot;https://www.youtube.com/embed/MZmNxvLDdV0&amp;quot; width=&amp;quot;560&amp;quot; height=&amp;quot;315&amp;quot; style=&amp;quot;border: none;&amp;quot; allowfullscreen=&amp;quot;&amp;quot; &amp;gt;&amp;lt;/iframe&amp;gt;&amp;lt;/p&amp;gt;&amp;lt;p&amp;gt; &amp;lt;img  src=&amp;quot;https://i.ytimg.com/vi/GSmKwiUc2mo/hq720.jpg&amp;quot; style=&amp;quot;max-width:500px;height:auto;&amp;quot; &amp;gt;&amp;lt;/img&amp;gt;&amp;lt;/p&amp;gt;&amp;lt;p&amp;gt; &amp;lt;img  src=&amp;quot;https://i.ytimg.com/vi/6v18uaoyeHw/hq720.jpg&amp;quot; style=&amp;quot;max-width:500px;height:auto;&amp;quot; &amp;gt;&amp;lt;/img&amp;gt;&amp;lt;/p&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; An ML engineer in KL posted: “I attended an LLM event where the presenter generated short responses. Fast. I asked &#039;what is the latency for a 500-word response?&#039; They had not measured. We tested. It took 45 seconds. &#039;Can you serve 100 concurrent users?&#039; I asked. They did not know. They had not considered production constraints. Now I ask for latency and throughput numbers explicitly.”&amp;lt;/p&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; Talk through with your coordinator: Do you measure throughput (tokens per second, requests per second).&amp;lt;/p&amp;gt;&amp;lt;h2&amp;gt;  Why &amp;quot;The LLM Knows Everything&amp;quot; Is False&amp;lt;/h2&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; LLMs do not know your internal documents. RAG retrieves relevant documents from a knowledge base.&amp;lt;/p&amp;gt;&amp;lt;p&amp;gt; &amp;lt;iframe  src=&amp;quot;https://www.youtube.com/embed/anefDK30uYU&amp;quot; width=&amp;quot;560&amp;quot; height=&amp;quot;315&amp;quot; style=&amp;quot;border: none;&amp;quot; allowfullscreen=&amp;quot;&amp;quot; &amp;gt;&amp;lt;/iframe&amp;gt;&amp;lt;/p&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; Pose these questions to coordinators: Do you illustrate the difference between parametric knowledge and contextually retrieved information.&amp;lt;/p&amp;gt;&amp;lt;h2&amp;gt;  The Difference between &amp;quot;Accurate&amp;quot; and &amp;quot;Plausible but Wrong&amp;quot;&amp;lt;/h2&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt; LLMs produce plausible but incorrect outputs. Verification mechanisms are necessary.&amp;lt;/p&amp;gt;&amp;lt;p  class=&amp;quot;ds-markdown-paragraph&amp;quot; &amp;gt;  &amp;lt;a href=&amp;quot;https://www.4shared.com/office/QRvDNgF-ge/pdf-23718-21771.html&amp;quot;&amp;gt;corporate event planner&amp;lt;/a&amp;gt;  recommends showing how LLMs can be wrong even when confident.&amp;lt;/p&amp;gt;&amp;lt;/html&amp;gt;&lt;/div&gt;</summary>
		<author><name>Carinekmin</name></author>
	</entry>
</feed>