Everand Logo

Welcome to Everand!

  • Discover millions of ebooks, audiobooks, and so much more with a free trial

    Only $11.99/month after trial. Cancel anytime.

    Spark GraphX in Action
    Spark GraphX in Action
    Spark GraphX in Action
    Ebook535 pages3 hours

    Spark GraphX in Action

    By Michael Malak and Robin East

    ()

    Read preview

    About this ebook

    Summary

    Spark GraphX in Action starts out with an overview of Apache Spark and the GraphX graph processing API. This example-based tutorial then teaches you how to configure GraphX and how to use it interactively. Along the way, you'll collect practical techniques for enhancing applications and applying machine learning algorithms to graph data.

    Purchase of the print book includes a free eBook in PDF, Kindle, and ePub formats from Manning Publications.

    About the Technology

    GraphX is a powerful graph processing API for the Apache Spark analytics engine that lets you draw insights from large datasets. GraphX gives you unprecedented speed and capacity for running massively parallel and machine learning algorithms.

    About the Book

    Spark GraphX in Action begins with the big picture of what graphs can be used for. This example-based tutorial teaches you how to use GraphX interactively. You'll start with a crystal-clear introduction to building big data graphs from regular data, and then explore the problems and possibilities of implementing graph algorithms and architecting graph processing pipelines. Along the way, you'll collect practical techniques for enhancing applications and applying machine learning algorithms to graph data.

    What's Inside
    • Understanding graph technology
    • Using the GraphX API
    • Developing algorithms for big graphs
    • Machine learning with graphs
    • Graph visualization

    About the Reader

    Readers should be comfortable writing code. Experience with Apache Spark and Scala is not required.

    About the Authors

    Michael Malak has worked on Spark applications for Fortune 500 companies since early 2013. Robin East has worked as a consultant to large organizations for over 15 years and is a data scientist at Worldpay.

    Table of Contents

      PART 1 SPARK AND GRAPHS
    1. Two important technologies: Spark and graphs
    2. GraphX quick start
    3. Some fundamentals
      4. PART 2 CONNECTING VERTICES
    4. GraphX Basics
    5. Built-in algorithms
    6. Other useful graph algorithms
    7. Machine learning
      8. PART 3 OVER THE ARC
    8. The missing algorithms
    9. Performance and monitoring
    10. Other languages and tools
    LanguageEnglish
    PublisherManning
    Release dateJun 12, 2016
    ISBN9781638353300
    Spark GraphX in Action
    Author

    Michael Malak

    Michael Malak has worked on Spark applications for Fortune 500 companies since early 2013.

    Related to Spark GraphX in Action

    Related ebooks

    Databases For You

    View More
    View More

    Related podcast episodes

    Related articles

    • Article

      An Introduction To Rabbitmq

      Jun 29, 2021

      RabbitMQ is a Message Broker, which means that it can safely hold messages generated by applications and make them available to other applications. The main advantages are reliability, support for clustering and high-availability queues, tracing capa

      1 min read

    • Article

      Are Docker Containers a Good Idea for Laptops?

      Mar 31, 2020

      Docker containers are cool. If you haven’t yet played with Docker, you’re missing a large world of easily deployed applications. For example, I can deploy NodeRed, Plex, Jupyter Lab, and Nextcloud servers, and run them behind a Traefik reverse proxy

      2 min read

    • Article

      Docker vs Podman

      Apr 19, 2021

      When Cockpit was first developed, it had plug-in support for administering your Docker containers remotely via its user-friendly web interface. But then Red Hat OS became a major backer of Cockpit, and when Red Hat developed its own alternative to Do

      1 min read

    • Article

      Traefik Configuration

      Mar 10, 2020

      In this tutorial we have configured Traefik using command-line switches in our Docker Compose file (the section starting command:). This is the equivalent of starting the application with a whole bunch of command options each time, and while this wou

      1 min read

    • Article

      Usability

      Oct 19, 2021

      Usability
      3 min read

    • Article

      Metrics & Visuals In Go

      Nov 17, 2020

      Mihalis Tsoukalos is a DataOps engineer and a technical writer. He’s the author of Go Systems Programming and Mastering Go, 2nd edition. The subject of this tutorial is two-fold. First, it’s about creating a Go application that exports metrics to P

      7 min read

    • Article

      What Is The Future Of Game Streaming Now That Stadia Is Dead?

      Oct 31, 2022

      Once hyped as being ‘the future of gaming’, the Google Stadia game streaming service was officially, just three years after launch and before even making it to Australian shores. When game streaming first launched we did have some apprehension about

      2 min read

    • Article

      Metasploitation

      May 2, 2023

      It’s a rare piece of code that never requires patching to fix some flaw or other that allows users to do what they were never meant to do. Exploits can be as simple as checking out plain text password files in an unprotected directory, or inputting s

      5 min read

    • Article

      Getting Started With The Powerful EBPF

      Sep 20, 2022

      Credit: https://ebpf.io Don’t miss next issue! Subscribe on page 16 Mihalis Tsoukalos is a systems engineer and a technical writer. You can reach him at www. mtsoukalos.eu and @mactsouk. Get the code for this tutorial from the Linux Format archive:

      10 min read

    • Article

      Installation

      Oct 19, 2021

      Installation
      1 min read

    • Article

      Basic Concepts

      Jul 2, 2019

      A messaging system such as Kafka enables you to send messages between processes, applications and servers. Applications connect to Kafka to send or get data. Strictly speaking, a Kafka ‘topic’ is a unit of storage in Kafka: data in Kafka is stored in

      1 min read

    • Article

      The Truth About Robots

      Feb 4, 2019

      Artificial intelligence is powerful—and misunderstood. What we need to know to protect workers

      3 min read

    • Article

      Hacking Away

      May 2, 2023

      It was a great experience to attend the Collabora Productivity Hackfest and talks in Cambridge. Not just to get up to speed on the latest online office technologies – which you can read about on page 90 – but to meet and encounter the depth of enthus

      1 min read

    • Article

      » Stochastic Algorithms

      Dec 14, 2021

      If you’re up for some relatively maths-heavy computer-science reading (and who isn’t?), then consider looking into stochastic algorithms. Sometimes lumped together with machine-learning, stochastic algorithms is a loosely defined category that you co

      1 min read

    • Article

      Create A Chrome Extension

      Jan 19, 2022

      Though I’ve been writing for tech magazines for 24 years, I don’t know much about coding. Kids today apparently start programming from the age of seven, whereas I never learned to do more than type 10 PRINT “Hello”. 20 GO TO 10. When I watch news sto

      2 min read

    • Article

      Mailserver

      Aug 22, 2023

      Do you have a burning Linuxrelated issue that you want to discuss? Write to us at Linux Format, Future Publishing, Quay House, The Ambury, Bath, BA1 1UA or email letters@ linuxformat.com. It has been said that one can tell what language a programmer

      4 min read

    • Article

      Roundup Digital Art Programs

      Sep 21, 2021

      Roundup Digital Art Programs
      1 min read

    • Article

      Redshift 3.5.19

      Jan 30, 2024

      Redshift 3.5.19
      3 min read

    • Article

      HotPicks

      Jun 30, 2020

      HotPicks
      13 min read

    • Article

      Computer-aided Design

      Jul 25, 2023

      Computer-aided Design
      13 min read

    • Article

      Observability Of The Kernel And Containers

      Apr 4, 2023

      Mihalis Tsoukalos is currently working on Time Series. You can reach him at: @mactsouk. For our final delve into eBPF, we’re tackling applications, the kernel and Docker containers. At the end of the day, all Linux machines execute code for applicat

      10 min read

    • Article

      HotPicks

      Sep 22, 2020

      HotPicks
      12 min read

    • Article

      FLASK Web Frameworks

      Jun 4, 2019

      The main focus of Python has always been to get you cracking on with your coding – the language was never made for web programming. However, this has just made it more interesting to extend the language for the web, or to create an interface to web-b

      9 min read

    Related categories

    Reviews for Spark GraphX in Action

    0 ratings

    0 ratings0 reviews

    What did you think?

    Tap to rate

    Review must be at least 10 words

      Book preview

      Spark GraphX in Action - Michael Malak

      {1abook_preview_excerpt.html}ْƒ寠_$3&2ּ2df-*)Uy AJaIo:1f#`-1뾪$X<|'vVg/]mպKG~ww߿pM"lWKה]*K\&V[&:onm䍩*|p%uaMkif^#ԕfm_yri66u}յ%dnњzSuy'XkJ䩫:b \jmB0mlm1F6uK71O/LmJxLC]ӡGG_?mWmA,2?C{|уyiL?3c-.'%m`ј ~^ KD4͝Iu ޙ"imgp5j˼4 XKK_')2OgI6/Sc]R_Ʋ[;K6yv}MN_lLQ%mʼmZA$tao6m6}K[L/IB omQߝvy53-L^03[涝'hwΜi@,?'oC auA-Czʫ#QORS )߁@{U`̼]ә*ka|Y&ie=:.!-ǿ9%Җ %Byvl,}iH$h=m.:>+1rxS%D|HiKf}^ }MO|MrlXG̰ ]=%)TfcmZh'4x.&ä$P8uh㙽h$vg^Fآoސ,(@mRՑhnJe߭I0]f+Ѯt{.haVM+7ϫ _&^%O?s]@6Oݰ;ElL_7}F"x<}㓧'Oq!L"G]w;/ɱH89INQ8yUcIڝOmH(V;   BڄO+yU=Jyr]C7BV׻S]MMГ7s[=QNK|-YFgOimɲ2#b;, GT.B^iza C,}豇ϋvX塇͓w钂Zl=LI6'=H^$!'DZWUf?|GxڥeЗGQT_ETQs?/~0s5l§xXD>;8K žW3әH25v sWG%fFkSj_y2VD Z^G[ˆB!o&n6 `"BpYv+j2'SѭwhWrWI*:]TT,.H;=,MlYBt;^Drq ߛq/zsƻ!vcL"4e?^{{}ƃEV&5[p4cI03-Yyîȴ_l+M[91'qdl6;wYZ*-p{(VB$<05mϾG*h3hѳ䆸Z.j7> O1SU&whi xCEe^ kW# !wX!x:y սg^ǤkWMD^+\tSRNeM>߽iא',($Cofj8HJ_~f$lt-l۬!y+-@ U6sW9cyv_F(Ә;Y JS36F"{/?ߐ(FS74QK*WRd'T_6ggk4ZԨO D%1d`<"7?JF*6,wN!XߛEx4H#dHK3]:Ź=cVOڔ[AxoWC +~l]N{k9"s|E{V+AڤI})_9L?yc 3}!-}Yz ZUD٨k)_XC3M+PW3}-ѧpts}'b!գ0۶_LZ'b؆N۸iH ;F'ԣXp#\D|V>u*fÉPQ !'2"tdF2j֖Q J!k2Z 1'<'n6p}rd33n8鯤˟2o: u@D6hCU^KtN?W@8tFh奍OYmfwHxJ?U VOKEry3~ic8'4S5^N&o/5\?&>l<%}m(Οq$G9|$H(1?<8gYk.7vӒ֦2/~:y_pd/qNp}FW߉0D&/|/׆StHYVmE t.Ǐh>"r'da亝k^&dRG{E W)r!|׫/C=roHVn>'k >!E*wyf?nlumW%Xg]w ^:uviH+j"gEc 6o_A>j@?JJfE.;% p)4 R:?&mf%d̓GQ-sٚD K=dPd"k-1o=ũ7Ex@ Yi&fw}Ly)R_}w'G~k0ɢ5Ko2o@7o@\;]m{[7W[ ˜C%@Í5Q/TB=m Z:T 0muE/Ĥz 9G{RdXB|Vl&3t`|`櫠Fi$CBuB5hi ҇9&oB&aAf-HAi3:g7iuIaPe@%]E`tʛ]KtB!#3@nhD@ bɚc`oE%%|Vqm:8]Ljz"`Nu6 zG #C7HXSjfgK-YۮrM<|8IR0;`F9ZLTMڥFj]j,7Ң|zU-Ms 0!.kV%e` PY@VL#uiT@m4vI=vD殰CdI-44\ AAI5RӴ]8^Q֜i-wd\FBki켔GN,h OG#= J|EQ`@VF .aY%/j (nQ~" V{KRu+VAfru.Mi9#/h4:ӪЁ{ecl(6aE)*`ELjFBOsb(F!nq qDLj$/6/6a]vĎܵ!O\ Dʙbn@hoJ6M֙Q*,f_wF ]I%u؊HOŐ4"_ Vk.Iq6zD|FCmY:> SBg?vj#p*F%v=xWoMDQQA:s_;6QzO 1'p )\#ِ`}AK Ośo{U3&'- Һ3|R;NzP!,B|yDH"YH1d1$G}u(ObܒU+"L-kA"k=,I|_1{ki3CNF/3[[wo yWf*;Q>y2ځIɖ-Ii_pӄm{VX,x v %io!ؕEG`0Pt;/['#9[EBYY=iI2:෈ėfņUTPGoxvbzx邚HxMo,6oIe6}MlO^&O2(6o0/ ]rAgbO W@M4|Ck- &`9Jw Ҷ^ʤzJs  ~]eprUGϋIl:2 ݲ`3X%@^SZ:zK%%qO?@Y\IQZ$T]/\I&|z<'e݁VI  0qm7 yQ# 녞AȠTf&2c^5Z!Wuq(l21wSFyfݚo WZ L& Bz] e?pxԕO?YY$0HD(LA'ıŹVܹ`sR@pr`T :Ga{*>) @z)-(0g",;X,r0{7珦7kI٨$AъAS;2 iŸc2(^uaEx߉;],;/HFyz t I&gsW$tT5>hT *0Ece*F{s./s>{r9nsҦnj|<GI5.6j9BsqǓS8.\-xlk|Yp#&c1T ZEȳ+K o$a+C=0JNb#!uQB: j&xƼ6TD}l| idtqSsCPGLoX?GA"}ѭEpbqwDž <9Tg9K4)#Wc#0/ V 9TΪ8OC=+z]Q&s:#rGHJ95%"R^P 5h5JOš>۰\u{ xH2%JlO lZ֚l9L#wEPŪg2%U!X}߈}p\ VH(çwXPx+f3d1#Wk+->l?W7nӎuۢG5)T^lbǂ+IFl 5$P&KC{9_Np`u=]j#ɬg-4[wFRYH-8a\լBI=H:BC OAmiZ"OG80!u/VIڋj<. h8&:#֍  gGfX]|!pzishIb÷"e{J?u Uy/D0Ћ8H2K/IC14k(r|+Hk06ڢU"o#[^kTTc uS(s׀lk׮MAs Cg9ڱCBtl/h/~|=[N7ryYr=I]%NspDf##!?RV s71 u9 6b#18(HV8$^ 8>@(qr(P5؆Ÿb)Nr85;t!PU1tx]M8ښYJ5I qbc6DA2b/;>m(CIWEh`0}v/EDT( -nNUۼOo^õIIv]rٍΚ=K„Zk _-=wo{\'XEǣ:2!Ba8[ 6c&zK}WV^wD)84ǍH˕e{cZWf{169KnȜ|;J!E #oT@ <:z`*ve\5R8zY̰y>GhMpoI*8 nI*7TC,1WPb t(dR\Wg(4r:&g2 k$FMqY:Y͙em}'Ho#^^"UZo[td2`Ɣ@%Y R WQ\kR"ѪVF?87#p#wJS(iHF%D M⽄[9 D;k>WcQ"VO**t}+>7*CNUg멅vE` \ y9r/O8=i\lkP">d,f$#Od] W\qd [x]tp؜)WMI|"hq/qru篑E둯KJz_<*lF[Q`0  ɞYrQ>fgـyL\@i'6L3N⛪M鼃at  ,jgrI΂lPI /dCa@7_b2y;^S/\i)b3HiN0z?U_޼&scnG嶚G5Okq{ tJ g؆5:`M쬎77w=Q bp$TRl++v"νw3fa+\cRF%U^i<4D/y.y'Grūz$2%@UcT5%m&[" m7X3gY>,E+NэZ $d{GfpEfiH 6P9l=;E |eUm3~ɩ UQX"8#"&U37q8bEqU\G"h<wNS.fqWvzu[+d`DAAfiLEebGE+:(ҏHH)BKſȏEmGex: O2K,h}ޭ+vRCK+[I+6hUr#7aYOrDWewQpWMg[9Dv`gfc3-W֌m5I0FTR8OLD3\JEB#kSup,m֙/q5{!MS\f߉P xd@ɩM1wl6rP?z%lI Tߟ(*]H@隻nO [@1qD*\kK(r(Q99,@[fUNJC1sIg(2):SD*x}:ܧ&M:(XRQkJV.׸։Č$EQ3q'JQ1 ,OWQ֋喖W'jce_O{Lrv,/ӠN'4+C )j|] Wm޴p@!(RRz|&5 #N&j ߽=vm"Yp| Vnl(S;C >@O^0Lr2) !'s;Q҆uuAC2-WJCC`icڵo1.٩um68%x_'7OޗU@ԇV@K̏Z_~12 ATD}D>[ H^ݗ\Vr|.A8sʥS吏c[,:VR[N=./"^Y}7@eiw G[&mt ^3`CLNm(oZ\i[;g.O<їhʸE%iPol%ȏ)\up'В0iMw菔.[9ϊ?N@MY|&/C amiU&׀IrIEWPz76!K_1GDG f5e6mx К̦XEHpDr'̈ݳ.V,.owW7aDC ďIJe9 R2ESԹߔCBա%0%HdWm$D}-1nc5?CgP+~4m鯻#<+͑hDD u˅&T70t=Rzs,\Ӝ*|~Tkdwxe@Z~f(= D3(|5\&= %"F [a:N8PPBǖ08K4RpFrޕ݈7Gl4zÝf}A}k݃_ qU%A6ܻ]%@RGÌ=_;fOD'~b u*znow 5J AB֔,kz;܋ (?4+gҐ ͈] cqS .=P7& 9+M˜~b l0}vTF|
      Enjoying the preview?
      Page 1 of 1