GettingStartedwithStorm

Getting Started with Storm，英文版Storm 手册，适合作为入门Getting Started with StormJonathan leibiusky, Gabriel eisbruchand dario Simonassi○ REILLYBeijing· Cambridge. Farnham·Koln· Sebastopol· TokyoGetting Started with Stormby Jonathan Leibiusky, Gabriel Eisbruch, and Dario SimonassiCopyright@ 2012 Jonathan Leibiusky, Gabriel Eisbruch, Dario Simonassi. All rights reservedPrinted in the United States of americaPublished by O Reilly Media, Inc, 1005 Gravenstein Highway North, Sebastopol, CA 95472O'Reilly books may be purchased for educational, business, or sales promotional use. Online editionsarealsoavailableformosttitles(http://my.safaribooksonline.com).Formoreinformationcontactourcorporate/institutionalsalesdepartment800-998-9938orcorporate@oreilly.comEditors: Mike Loukides and Shawn WallaceCover Designer: Karen MontgomeryProduction Editor: Melanie YarbroughInterior Designer: David Futatolustrator Rebecca demarestRevision History for the First Edition:2012-08-30First releaseSeehttporeillycom/catalog/errata.csp?isbn=9781449324018forreleasedetailsNutshell Handbook, the Nutshell Handbook logo, and the O'Reilly logo are registered trademarks ofO'Reilly Media, Inc. Getting Started with Storm, the cover image of a skua, and related trade dress aretrademarks of O'Reilly Media, IncMany of the designations used by manufacturers and sellers to distinguish their products are claimed astrademarks. Where those designations appear in this book, and O'Reilly Media, Inc, was aware of atrademark claim, the designations have been printed in caps or initial capsWhile every precaution has been taken in the preparation of this book, the publisher and authors assumeno responsibility for errors or omissions, or for damages resulting from the use of the information contained hereinISBN:978-1-449-32401-81346349770Table of contentsPreface1. basicsThe Components of StormThe Properties of Storm2. Getting StartedOperation ModesLocal modeRemote modeHello world storm35556677Checking Java InstallationCreatigthe prCreating Our First TopologypoutBoltsThe Main Class16See it in actiononclusion3. Topologies21Stream Grouping21Shuffle grouping22Fields Grouping22All Grouping22ustom GroupingDirect groupingGlobal grouping344None grouping25LocalCluster versus Storm Submitter25DRPC Topologies264. SpoutsReliable versus Unreliable messages9Getting DataDirect connection31Enqueued Messages34DRPC36Conclusion5. BoltsBolt lifecycle39Bolt structure39Reliable versus unreliable bolts40Multiple streamsMultiple anchoring42Using IBasicBolt to Ack Automaticall426. A Real-Life ExampleThe Node. js Web application44Starting the Node js Web applicationThe Storm TopologyUsers Navigationspout48GetCategory Bolt49UserHistory bolt50Product Categories CounterBoltNews NotifierBoltThe redis serverProduct informationUser Navigation QueueIntermediate Data56Results57Testing the topology57Test initialization7A Test ExampleNotes on Scalability and availability607. Using Non-JVM Languages with Storm,61he multilane Protocol Specification63Initial handshake63Start Looping and Read or Write Tuples8. Transactional Topologies71The designiv Table of ContentsTransactions in ActionThe Spout73The boltsThe Committer boltsPartitioned Transactional SpoutsOpaque transactional Topologies84A. Installing the Storm Client87B. Installing Storm Cluster......................... 89C. Real life example setup,,91Table of Contents vPrefaceIf you're reading this, it's because you heard about Storm somehow, and you're interested in better understanding what it does, how you can use it to solve various problems,and how it worksThis book will get you started with Storm in a very straightforward and easy wayThe first few chapters will give you a general overview of the technologies involvedsome concepts you should understand so we all speak the same language, and how toinstall and configure Storm. The second half of the book will get you deep into spoutsbolts and topologies (more about these in a moment). The last few chapters addresssome more advanced features that we consider very important and interesting, likeusing Storm with languages that are not JVM-basedConventions Used in this bookThe following typographical conventions are used in this bookItalicIndicates new terms. URLs. email addresses filenames. and file extensionsConstant widthUsed for program listings, as well as within paragraphs to refer to program elementssuch as variable or function names, databases, data types, environment variablesstatements, and keywordsConstant width boldShows commands or other text that should be typed literally by the userConstant width italicShows text that should be replaced with user-supplied values or by values determined by contextThis icon signifies a tip, suggestion, or general noteThis icon indicates a warning or cautionUsing〔 ode ExamplesThis book is here to help you get your job done. In general, you may use the code inthis book in your programs and documentation. You do not need to contact us forpermission unless you're reproducing a significant portion of the code. For examplewriting a program that uses several chunks of code from this book does not requirepermission. Selling or distributing a CD-ROM of examples from O'Reilly books doesrequire permission. Answering a question by citing this book and quoting examplecode does not require permission. Incorporating a significant amount of example codefrom this book into your product's documentation does require permissionWe appreciate, but do not require, attribution. an attribution usually includes the title,author, publisher, and ISBN. For example: "Getting Started with Storm by JonathanLeibiusky, Gabriel Eisbruch, and Dario Simonassi(O'Reilly). Copyright 2012 JonathanLeibiusky, Gabriel Eisbruch, and Dario Simonassi, 978-1-449-32401-8If you feel your use of code examples falls outside fair use or the permission given abovefeelfreetocontactusatpermissions@oreilly.comSafari books onlinend disSafari. library that delivers expert content in both book and video form from theworld's leading authors in technology and businessTechnology professionals, software developers, web designers, and business and cre-ative professionals use Safari books Online as their primary resource for researchproblem solving, learning, and certification trainingSafari Books Online offers a range of product mixes and pricing programs for organizations, government agencies, and individuals. Subscribers have access to thousandsof books, training videos, and prepublication manuscripts in one fully searchable database from publishers like O'Reilly Media, Prentice Hall Professional, Addison-WesleyProfessional, Microsoft Press, Sams, Que, Peachpit Press, Focal Press, Cisco Press, JohnWiley sons, Syngress, Morgan Kaufmann, IBM Redbooks, Packt, Adobe Press, FTPress, Apress, Manning, New Riders, McGraw-Hill, Jones Bartlett, Course Technology, and dozens more. For more information about Safari Books Online, please visitus onlineⅶ ii Preface