一个辅助写作框架：Storm

辅助写作的流程/业务

1. 输入：用户意图（主题、描述）

2. 生成若干视角下的问题

3. 检索并浏览、总结相关网页

4. 生成文章

示例1: 关于艾尔登法环的新人引导文章

输入

检索

这个过程，如何知道应该检索哪些数据源？依赖搜索引擎的排名的权威性？

头脑风暴

从四类人的视角看问题：

• 传奇故事爱好者

• 玩家社区代表

• 基本事实写作者

• 游戏设计者

传奇故事爱好者

A devoted fan of the game’s narrative, this editor will delve into the lore of Elden Ring, examining its setting, characters, and story elements. They will compare it to the lore in previous FromSoftware games and highlight the connections and thematic continuity.

• 如何解读艾尔登法环中的传说故事的主旨，ta与FromSoftware社以前的游戏作品有何不同？

  The lore of Elden Ring, much like previous FromSoftware games, is rich, intricate, and often shrouded in mystery, requiring players to piece together the story from item descriptions, dialogues, and environmental storytelling [5]. This approach is a hallmark of director Hidetaka Miyazaki's narrative style, which can be seen across the Dark Souls series, Bloodborne, and Sekiro: Shadows Die Twice [1]. One of the central themes in Elden Ring is the concept of power and its corruptive influence. Players take on the role of a Tarnished, a character who must traverse the Lands Between to collect Great Runes and reforge the Elden Ring in order to become the Elden Lord [2]. This journey involves confronting demigods who have been driven to madness and corruption by their own power, reflecting a recurring theme in FromSoftware games where the pursuit of power often leads to ruin and despair [1]. The theme of fire and its origins is another prevalent narrative device in Elden Ring, echoing motifs from the Dark Souls series, where the Age of Fire and the cycles of light and dark play a significant role [1]. This reuse of thematic elements provides a sense of continuity across FromSoftware's body of work, despite each game having its own unique setting and story. Additionally, the lore of Elden Ring is heavily influenced by Norse mythology, contributing to the game's depth and complexity. This mythological underpinning shapes the world and its characters, adding layers to the narrative that players can explore [4]. Compared to previous games, Elden Ring's story is more expansive, involving a larger world with numerous interwoven tales and a rich history that players can uncover through exploration and curiosity [6]. This complexity has led to mixed reactions from the community, with some praising the depth and others finding it challenging to follow [3]. The collaboration between Miyazaki and renowned fantasy author George R. R. Martin has also brought a new dimension to the lore, infusing it with Martin's intricate world-building and character-driven storytelling [7]. This partnership has contributed to the game's vast and detailed mythos, making it a standout entry in FromSoftware's catalog. In summary, the main themes of Elden Ring's lore—power and corruption, fire and its origins, and mythological influences—are consistent with those in previous FromSoftware games. However, the collaborative effort with George R. R.
  

• 能否阐述艾尔登法环中的关键角色及其对故事的重要性？

  Certainly! Elden Ring, developed by FromSoftware, boasts a rich tapestry of characters integral to its lore. The game’s setting, the Lands Between, is teeming with powerful beings that the player, assuming the role of the Tarnished, interacts with during their quest to become Elden Lord. One of the most critical characters is **Queen Marika**, the goddess whose actions set the game's events into motion. Marika's shattering of the Elden Ring led to the disarray in the Lands Between, making her a pivotal figure in understanding the world's current state [1][4]. Another key character is **Dragonlord Placidusax**, a powerful dragon and one of the game's lore’s most potent beings. His presence underscores the ancient and mythic nature of the challenges the Tarnished faces [1]. **Malenia, Blade of Miquella**, is another significant figure. Despite being one of the game's most difficult bosses, her backstory involving the Scarlet Rot and her devotion to her brother Miquella enriches the narrative profoundly [3]. Her struggles and eventual descent are emblematic of the larger themes of decay and struggle in the game. **Mohg, Lord of Blood**, represents another tier of significant characters. His dark ambitions and connections to the blood-soaked rituals add another layer of depth to the lore, emphasizing the different power dynamics at play in the Lands Between [3]. The Shadow of the Erdtree DLC expands on these existing characters while introducing new ones like **Romina** and **the Hornsent**. These characters provide further insights into critical aspects such as the origins of the Scarlet Rot and the Omens, thereby enriching the player’s understanding of the game’s universe [2]. Elden Ring’s family tree and relationships among characters are intricate. For instance, understanding the connections between Marika, her offspring, and their factions is crucial for grasping the complex political and divine struggles within the game. This relational web is essential for players to fully appreciate the motivations and conflicts driving the narrative [5]. In summary, Elden Ring's key characters, from demigods like Malenia to mythic figures like Dragonlord Placidusax and essential lore-bearers introduced in the DLC, create a layered and immersive story.
  

• 艾尔登法环的背景故事和关键角色间的关系如何增强游戏的叙事性和玩家体验？

  The backstories and relationships between key characters in Elden Ring significantly enhance the game's narrative and player experience by adding layers of depth and complexity to the world of The Lands Between. Elden Ring's storytelling style, a collaboration between FromSoftware's Hidetaka Miyazaki and George R. R. Martin, employs subtlety and nuance, often requiring players to piece together information from various dialogues, item descriptions, and environmental cues [1][7]. A major element of the game's narrative is the intricate family tree of its characters, which influences much of the storyline. The characters' relationships, often shrouded in mystery and revealed through exploration and interaction, create a compelling backdrop that motivates players to delve deeper into the lore [1]. For example, understanding the connections between characters like Queen Marika, Godfrey, and their demigod offspring can provide players with insight into their motivations and the larger narrative forces at play. The subtlety of the storytelling also means that players must engage actively with the game to uncover its secrets. This approach sparks a sense of curiosity and encourages exploration, as players gather lore from defeated enemies and conversations with NPCs [3][6]. The detailed backstories of characters such as the Night of the Black Knives or the House of the Moon, which are meticulously explained by lore experts like YouTube creator VaatiVidya, further enrich the narrative and provide a more comprehensive understanding of the game's events [4]. Furthermore, the cryptic nature of the story has been a point of both acclaim and criticism. While some argue that the ambiguous narrative makes it difficult to follow [2], others appreciate the depth it adds, making the discovery of each story element feel rewarding. This complexity also fosters community engagement, as players collaborate to piece together the lore and share their findings, creating a shared experience that extends beyond individual gameplay [3]. Overall, the interwoven backstories and relationships in Elden Ring enhance the narrative by creating a richly textured world that rewards exploration and active engagement. This storytelling method not only captivates players but also ensures that each playthrough can reveal new insights, making the game an enduring and immersive experience.
  

玩家社区代表

This editor will focus on player experiences and community engagement surrounding Elden Ring. They will cover multiplayer features, player-created content, and community discussions, showcasing how the game has fostered a unique social environment.

• 艾尔登法环的多玩家特性如何冲击玩家群体间的“约玩”和协作？

  The multiplayer features in Elden Ring have had a significant impact on player engagement and collaboration within the community, enhancing the overall gaming experience. Elden Ring maintains the core cooperative play mechanics familiar to fans of FromSoftware's games, such as summoning other players to assist with challenging areas or boss fights. However, Elden Ring has made this process more accessible compared to its predecessors, such as Dark Souls and Demon's Souls, by removing the need for rare items to summon help (Source [2]). The game allows players to create a summoning sign using the Tarnished's Furled Finger, enabling them to join others' games and provide assistance (Source [1]). This streamlined approach to multiplayer functionality has encouraged more players to engage in cooperative play, as they can more reliably and consistently summon allies or join other players' sessions without worrying about depleting precious resources. Additionally, Elden Ring includes a dedicated multiplayer menu where players can easily manage their multiplayer activities, whether it’s cooperating with friends, random players, or engaging in PvP invasions (Source [3]). This user-friendly interface makes it easier for players to navigate the multiplayer aspects, thus promoting more frequent and meaningful interactions within the community. The inclusion of tools to ease summoning woes, such as multiplayer passwords and effigies, further facilitates a smoother cooperative experience, reducing the barriers to engaging with other players (Source [1], [7]). Moreover, the complex and challenging nature of Elden Ring's world encourages collaboration. Many players find that tackling the game's toughest challenges is more manageable and enjoyable when done with friends or allies, enhancing the sense of community and shared adventure (Source [4], [6]). While Elden Ring does not currently support crossplay between different platforms, the multiplayer features available have still managed to foster a robust and active player community, allowing for extensive cooperative gameplay and dynamic PvP encounters (Source [5]). Overall, the multiplayer features in Elden Ring have positively impacted player engagement by making cooperative play more accessible, encouraging collaboration, and providing a variety of tools and systems to enhance the multiplayer experience. This has led to a more connected and supportive player community, where adventurers in The Lands Between can join forces to overcome the game's formidable challenges.
  

• 玩家自定义内容（如模组和自定义建筑）如何影响社区活力和玩家互动？

  Player-created content, such as mods and custom builds, has significantly influenced community dynamics and interactions among players in Elden Ring. The modding community has introduced various modifications that enhance and diversify the gaming experience, impacting how players engage with both the game and each other. One notable example is the "Seamless Co-op" mod developed by LukeYui. This mod addresses the shortcomings of Elden Ring’s original cooperative play system, which was criticized for its complex item requirements, frequent disconnects, and restrictive gameplay (Source [4]). By providing a more user-friendly and stable co-op experience, the Seamless Co-op mod has facilitated smoother interactions among players, enabling them to explore the game’s vast world together without the frustration of technical difficulties (Source [4]). Moreover, mods such as "Elden Ring Reborn" have brought comprehensive overhauls to the game, touching nearly every aspect of it in meaningful ways (Source [3]). These extensive modifications, which include new skills, balance adjustments, and even randomized gameplay elements, cater to a variety of player preferences and playstyles (Source [1], Source [5]). As a result, players can customize their experience to suit their individual tastes, leading to a more personalized and engaging community dynamic. Additionally, the introduction of various mods has fostered a collaborative environment among modders and players. For example, the "Elden Ring Reborn" mod credits multiple contributors who assisted in different aspects of the mod’s development, showcasing the collaborative spirit within the modding community (Source [3]). This collaboration not only enhances the quality and diversity of mods available but also strengthens the bonds between community members as they work together to improve the game. Furthermore, mods like "Easy Mode" and "No Rune Loss" offer accessibility options for players who may find the game’s difficulty too challenging (Source [8]). By lowering the barrier to entry, these mods enable a wider range of players to participate in the Elden Ring community, fostering inclusivity and encouraging more interactions among diverse player groups. Overall, player-created content has significantly shaped the community dynamics in Elden Ring by enhancing cooperative play, providing diverse gameplay options, and fostering a collaborative and inclusive environment. The modding community continues to be a driving force in evolving the game, ensuring that players have new and exciting ways to experience The Lands Between.
  

• 玩家如何参与关于艾尔登法环游玩策略和经验的讨论？哪些平台对于玩家互动而言最为流行？

  Players typically engage in discussions about strategies and experiences related to Elden Ring on various platforms and forums. One of the most popular platforms is Steam, where the community section provides a space for players to share tips, ask for help, and discuss game mechanics [1][2]. Another significant platform is social media, as Elden Ring itself has been described as an "entire social media platform unto itself," where players can leave messages, bloodstains, and summon signs to communicate indirectly within the game world [4]. This feature allows players to share hints, warnings, and jokes, fostering a unique in-game community. Online multiplayer engagement is a central aspect of the Elden Ring experience. Players can summon or be summoned for cooperative play to help defeat bosses or engage in PvP combat. This is facilitated by items like the Tarnished's Furled Finger and by activating the Effigies of the Martyr, allowing for both co-op and PvP interactions [5][6]. Additionally, players use multiplayer passwords to join friends or specific communities, ensuring they can play together despite the asynchronous nature of the game's multiplayer system [6]. Despite some clunkiness in the cooperative play setup, these various in-game and external platforms help create a robust community where players can share their strategies, experiences, and insights into the game [5]. I cannot answer this question based on the available information about platform-specific performance comparisons for playing Elden Ring, as this does not relate to community discussions and forums. These platforms and systems collectively support a rich and engaging community experience for Elden Ring player
  

基本事实写作者

Basic fact writer focusing on broadly covering the basic facts about the topic.

• 能否对艾尔登法环幕后开发过程的整体情况进行介绍？

  Certainly! Here is an overview of the development process behind "Elden Ring," including key individuals and studios involved: "Elden Ring" is a 2022 action role-playing game developed by FromSoftware, a Japanese game development studio. The game was directed by Hidetaka Miyazaki, who is renowned for his work on other FromSoftware titles such as Dark Souls, Bloodborne, and Sekiro: Shadows Die Twice. The worldbuilding for Elden Ring was provided by American fantasy writer George R. R. Martin, best known for his "A Song of Ice and Fire" series, which was adapted into the television series "Game of Thrones" [1][4]. The development of Elden Ring marked FromSoftware's first foray into the open-world genre. This ambitious project involved a significant departure from the studio's previous games, which were known for their interconnected but more linear worlds. The game's development ran parallel to that of Sekiro: Shadows Die Twice, although there was limited direct feedback between the two projects [2][7]. Miyazaki has described the development process as a blend of leveraging FromSoftware’s extensive experience with challenging gameplay and incorporating new elements such as a vast, explorable landscape. This open-world design offered players the freedom to explore, a significant shift from the more structured environments of earlier FromSoftware titles [2][4]. During the development, Miyazaki and his team faced numerous challenges, especially as the game approached its launch. The pressure was high, as expectations were significant due to the involvement of high-profile figures like Miyazaki and Martin. The final stages of development were intense, with the team working hard to meet the launch deadlines [3]. Elden Ring was published by FromSoftware in Japan and internationally by Bandai Namco Entertainment. The game was released on February 25, 2022, for multiple platforms including PlayStation 4, PlayStation 5, Windows, Xbox One, and Xbox Series X/S [1][5]. In summary, the development of Elden Ring was a complex and highly collaborative process involving FromSoftware, Hidetaka Miyazaki, and George R. R. Martin. It represented a significant evolution for FromSoftware as they ventured into the open-world genre, combining their signature challenging gameplay with expansive worldbuilding.
  

• 能否详细阐述游戏的主要叙事和主题，与前作相比有何差异？

  "Elden Ring" presents a deep and intricate narrative, rooted in a fantastical world known as the Lands Between. The game's story, a collaboration between Hidetaka Miyazaki and George R. R. Martin, is both rich and complex, following the tradition of previous FromSoftware titles but with distinct differences in themes and storytelling. In "Elden Ring," players assume the role of a Tarnished, an individual who has lost the golden glow in their eyes, symbolizing the grace of the Erdtree. This giant, golden tree is central to the game's lore, as it radiates grace and power across the Lands Between [4]. The Tarnished are tasked with obtaining the Elden Ring, a powerful artifact, and ascending to the status of Elden Lord by defeating various demigods and claiming their powers [1][3]. The overarching narrative involves understanding the history and fallout of the Lands Between, particularly an event known as the Shattering, which fragmented the world and its rulers. This event and its consequences are pieced together through exploration, dialogues with NPCs, and item descriptions, a storytelling method that echoes the cryptic narrative style of the Soulsborne series [5][6]. Unlike more straightforward narratives, "Elden Ring" requires players to be curious and actively seek out lore to fully grasp the story [5]. Thematically, "Elden Ring" explores ideas of power, loss, and the cyclical nature of ambition and destruction. The Tarnished, much like the protagonists in previous FromSoftware games, embark on a journey filled with peril and uncertainty, seeking to restore or reshape a broken world. However, the inclusion of George R. R. Martin's influence brings a layered complexity to the world's history and character motivations, infusing the game with intricate mythological and political underpinnings [7]. One of the significant differences between "Elden Ring" and earlier FromSoftware games, such as the Dark Souls series, is its open-world structure. This vast, interconnected environment offers players unprecedented freedom to explore and uncover the story at their own pace, rather than following a more linear path [2]. Despite the expansive setting, the game maintains the studio's signature difficulty and atmospheric storytelling, blending accessibility with the challenge that long-time fans expect [8]. In summary, "Elden Ring" continues FromSoftware's tradition of deep, enigmatic storytelling, enhanced by George R. R. Martin's world-building.
  

• 艾尔登法环的关键游戏机制是什么？与前作相比，如何增强玩家体验？

  "Elden Ring," developed by FromSoftware, incorporates a blend of familiar and novel gameplay mechanics that significantly enhance the player experience, setting it apart from previous titles by the same developer. One of the standout features of "Elden Ring" is its expansive open-world design, a departure from the more linear pathways of the Dark Souls series and Bloodborne.
  

游戏设计者

This editor will focus on the development process of Elden Ring, exploring its mechanics and design philosophies in relation to other titles by FromSoftware. They will analyze how Elden Ring innovates within the action role-playing game genre and its impact on game design trends.

• 能否阐述指导法环开发的关键设计哲学？特别是与前作相比有何差异？

  Certainly! The development of Elden Ring by FromSoftware, under the direction of Hidetaka Miyazaki, is guided by several key design philosophies that both build upon and innovate the elements seen in previous FromSoftware games, particularly the Dark Souls series. Firstly, **Elden Ring expands upon the core mechanics familiar to Dark Souls fans**. This includes weighty combat, character mechanics, and the overall dark-fantasy atmosphere. According to [3], the game retains the successful foundations of the Dark Souls trilogy but revolutionizes the subgenre with open-world traversal, expanded combat mechanics, and enhanced character customization. One of the most significant changes is the **transition to an open-world format**, which provides areas with a greater sense of scale and exploration freedom, as noted in [3]. This design choice marks a departure from the more linear progression found in Dark Souls, giving players the ability to explore the Lands Between more freely and encounter a variety of challenges and secrets along the way. Another fundamental shift in design is **the inclusion of more dramatic changes and additions to the established mechanics**. While the core gameplay may feel familiar, Elden Ring introduces substantial innovations. According to [2], these changes are more dramatic than those seen across the three Dark Souls games. For example, the terminology has been updated—experience points, traditionally called "souls," are now referred to as "runes," as stated in [4]. The design philosophy of **"freedom of failure"** is also a cornerstone of FromSoftware's approach, as articulated by Miyazaki. This principle encourages creative freedom and risk-taking within the development team, fostering an environment where innovative ideas can thrive without the fear of failure. This is highlighted in [8], where Miyazaki's stance on development emphasizes that allowing freedom in making mistakes ultimately leads to better and more creative games. Additionally, the collaboration with **George R.R. Martin** for the game's mythos adds a rich narrative layer that differentiates Elden Ring from its predecessors while still maintaining the dark, immersive storytelling that fans expect. This collaboration is confirmed in [5], where Martin's involvement is mentioned in developing the game's mythos. In summary, the key design philosophies guiding Elden Ring's development include maintaining the core mechanics that fans love from the Dark Souls series while introducing significant innovations such as an expansive open-world format, updated mechanics, and a narrative collaboration with George R.R. Martin.
  

• 相比黑暗之魂系列，艾尔登法环引入了哪些新的游戏机制和特性？

  Elden Ring introduces several new gameplay mechanics and features that set it apart from the Dark Souls series while still retaining the familiar elements that fans of FromSoftware's games will recognize. Here are some of the key differentiators: 1. **Open-World Exploration**: Unlike the relatively linear structure of the Dark Souls games, Elden Ring features a vast open-world environment known as the Lands Between. This open-world format provides players with greater freedom to explore diverse landscapes and uncover hidden secrets at their own pace, enhancing the sense of scale and immersion ([8]). 2. **Day and Night Cycle**: One of the notable new mechanics in Elden Ring is the inclusion of a dynamic day and night cycle. This cycle can affect enemy behavior and visibility, adding another layer of strategy to exploration and combat ([5]). 3. **Mounted Combat and Traversal**: Elden Ring introduces mounted combat, allowing players to fight enemies while riding a spectral steed. This new mechanic adds a layer of tactical depth to engagements and facilitates quicker travel across the expansive game world ([2]). 4. **Stealth Mechanics**: Borrowing from FromSoftware's previous title, Sekiro: Shadows Die Twice, Elden Ring incorporates stealth mechanics. Players can crouch, hide in tall grass, and perform stealth attacks on unsuspecting enemies, providing alternative approaches to combat situations ([5]). 5. **Jumping and Verticality**: Unlike the Dark Souls series, Elden Ring allows players to jump freely, which enhances vertical exploration and platforming elements. This new mechanic encourages players to explore the environment in three dimensions, searching for hidden paths and treasures ([5]). 6. **Spirit Summons**: A unique addition to Elden Ring is the ability to summon spirits to aid in combat. These spirits, which can be collected and upgraded, provide valuable assistance in battles, offering support and strategic advantages ([5]). 7. **Enhanced Character Customization**: Elden Ring builds on the character mechanics seen in Dark Souls but offers more extensive customization options. Players can tailor their character's abilities, appearance, and playstyle to a greater degree, making the experience more personalized ([8]). 8. **Improved Map and Navigation**: Elden Ring features a more detailed map system that helps players navigate the expansive world. Map fragments can be collected to reveal new areas, and markers can be placed to highlight points of interest, making exploration more manageable ([1]).
  

• 新的游戏机制如何影响玩家策略和游戏在社区整体的受欢迎度？

  The introduction of new gameplay mechanics in Elden Ring has significantly influenced player strategies and the overall reception of the game among the gaming community. One of the most notable additions is the day and night cycle, which affects gameplay by altering visibility and enemy behavior. For instance, certain enemies only appear at night, and both players and enemies have reduced visibility during these hours, making encounters more unpredictable and strategic (Sources [1], [5]). This mechanic encourages players to plan their actions according to the time of day, adding a layer of depth and immersion to the game. Dynamic weather is another new feature that influences how players approach combat and exploration. Weather conditions such as heavy wind or rain can obscure sounds, making it easier or harder for players to sneak up on enemies or avoid detection (Source [5]). This dynamic environment requires players to constantly adapt their strategies based on the weather, adding complexity to their decision-making process. Mounted combat and the ability to summon spirit familiars are additional mechanics that have expanded the range of tactical options available to players. Mounted combat allows for greater mobility and new attack strategies, while summoning spirits can provide support in difficult battles, making it possible for players to tackle challenging foes with additional aid (Sources [1], [5], [8]). The game's open-world design also plays a crucial role in shaping player strategies. Unlike the more linear progression of previous FromSoftware titles, Elden Ring's expansive world invites exploration and offers multiple pathways to approach objectives. This flexibility allows players to engage with the game at their own pace and choose their battles, fostering a more personalized gaming experience (Sources [1], [4]). The reception of these new mechanics among the gaming community has been largely positive. Players have appreciated the increased freedom and variety in gameplay, which builds on the challenging and rewarding core mechanics that FromSoftware is known for. The introduction of new features like dynamic weather, day and night cycles, and mounted combat have been praised for adding depth and variety to the gameplay, enhancing the overall experience (Sources [3], [6], [9]). In conclusion, the new gameplay mechanics in Elden Ring have not only influenced player strategies by adding layers of complexity and adaptability but have also been well-received for enriching the game's depth and replayability. These innovations demonstrate FromSoftware's commitment to evolving its established action RPG formula, keeping the gameplay fresh and engaging for both veteran players and newcomers alike.
  

文章结果

生成了大纲和文章，并可导出PDF。

反馈（通用）

原理

论文速读：《Assisting in Writing Wikipedia-like Articles From Scratch with Large Language Models》

文章地址: 链接

• 工作：应用大语言模型从头开始撰写蕾丝维基百科页面那样兼具广度和深度、同时有依据的（grounded）和有条理的（organized）长篇文章。

• 挑战：预写作阶段（pre-writing stage），包括如何对文章主题进行调研以及在写作前准备一个大纲。

• 成果：提出STORM写作系统，通过检索和多视角问题回答生成主题大纲（Synthesis of Topic Outlines through Retrieval and Multi-perspective Question Asking）

• STORM基本流程：

  1. 视角发掘：发现关于给定主题的多种视角

  2. 模拟对话：写作者抛出多种不同视角下的问题与主题专家对话，主题专家的回答基于可信互联网信息源。

  3. 组织文章：将收集到的信息组织起来生成一个提纲

• 如何验证：

  • 构建FreshWiki，高质量的维基百科文章数据集

  • 提纲评价指标用于评估预写作阶段的效果。

  • 获取有经验的维基百科编辑者的反馈

• 效果

  • 1️⃣提纲驱动（outline-driven）与检索增强（retrieval-augumented）的方法作为基准，大部份STORM生成的文章更有条理（25%+），而且覆盖面更广（10%+）。

• 新的挑战

  • 数据源偏见（source bias）

  • 对无关事实的过度联想

导图

相关工作及问题

• 预先准备好引用文献或预先准备大纲

  难以泛化。对专业知识要求高：识别、评估、组织外部数据源，对于专业作者来说也有挑战。

• 直接依赖大模型的参数知识生成每篇文章的提纲。

  受限于缺乏细节和大模型幻觉。

• 知识获取：Asking effective question。基于指令优化的模型尽管可以生成一些“问题”，，但往往只是基本的“What”、“When”、“Where”，通常只能处理关于主题的表面、浅层的事实性问题……

STORM的基本假设

• 多种视角可以得到多样的问题（Diverse perspectives lead to varied questions）

  如前面的示例，撰写一份艾尔登法环新人指引，分别从故事爱好者、玩家代表、故事写作者、游戏设计者四类人的视角提问。

• 提出有深度的问题需要迭代式调查（Formulating in-depth questions requires iterative research）

基于上述假设，STORM采用多阶段方法。

1. 首先，通过检索和分析维基百科的相似主题的文章进行视角发现。

2. 然后，让LLM以拟人化的方式就特定视角进行提问

3. 引出后续（follow-up）问题用于迭代式调研

4. 模拟多轮对话使得答案有理有据（引用互联网内容）

5. 最后，基于LLM内部知识和收集到的信息，构建题纲，一章一章撰写形成类似维基百科文章的全文。

问题抽象化表述：给定主题t，找到一组引用集合$R$并生成完整的文章$S=s_{1}s_{2}…s_{n}$，其中每个句子$s_{i}$引用R中的一部份。（注：具体实践上，S也包括一些不要求引用的文章结构性要素，如章节标题、子章节标题）

主要贡献

• 构建数据集FreshWiki和评价标准，可用于提纲质量评价和文章质量评价

• 提出STORM，一个新型自动化写作系统，使用LLM对主题进行调研、构建提纲和检索互联网上的可信数据源

• 自动化和人工评价的方式证明方法的有效性。

Remark：

数据集构建的原则是什么？

针对提纲和文章的自动化评价标准分别是什么？

人工评价如何做到客观性？

如何判断数据源是否可信？

FreshWIki数据集

• 如何确保日期标准：2022年2月到2023年11月的文章中，编辑次数最多的页面。选择top-100编辑次数最多的页面。

  

• 如何确保引用的高质量：根据ORES的评估结果，只保留B-class或以上质量评级的文章。

  评级说明：Wikipedia:Content assessment - Wikipedia

• 简化任务

  • 排除列举型文章(Wikipedia:Stand-alone lists)

  • 只考虑纯文本的文章

ORES: Objective Revision Evaluation Service: 客观修订评估服务

通常高质量的文章包含结构化数据（如表格）并且是多模态的。

提纲创建和评估

• 任务拆解：

  • Pre-Writing Stage：生成提纲O。

    如何表示提纲？添加#表示章节标题、##表示子章节标题。

  • Writing Stage：给定主题t、参考文献R和提纲O，生成完整文章S。

• 评估提纲的覆盖率

  • Heading soft recall：对标题的嵌入向量进行余弦相似性的计算。

  • Heading entity recall： 标题中命名实体的百分比

方法

• Perpective-Guided Question Asking

• Simulating Converations

• Creating the Article Outline

• Writing the Full-Length Article