[Info-vax] Should VSI create a modern day VMS applications book ?

[Kerry Main]

> -----Original Message-----
> From: Info-vax <info-vax-bounces at rbnsn.com> On Behalf Of Arne Vajhøj
> via Info-vax
> Sent: August 19, 2018 2:30 PM
> To: info-vax at rbnsn.com
> Cc: Arne Vajhøj <arne at vajhoej.dk>
> Subject: Re: [Info-vax] Should VSI create a modern day VMS applications
> book ?
> 
> On 8/19/2018 9:34 AM, Neil Rieck wrote:
> > On Sunday, August 19, 2018 at 12:15:53 AM UTC-4, Dave Froble wrote:
> >> On 8/18/2018 11:25 PM, Arne Vajhøj wrote:
> >>> On 8/18/2018 1:13 PM, Phillip Helbig (undress to reply) wrote:
> >>>> Big data is like teenage sex: everyone talks about it, nobody
> >>>> really knows how to do it, everyone thinks everyone else is doing
> >>>> it, so everyone claims they are doing it.
> >>>>
> >>>> ---Dan Ariely
> >>> Big data is being used.
> >>>
> >>> Intelligence agencies, social media, retail, health care, election
> >>> campaigns, science, sports etc..
> 
> >> Don't have a clue what "big data" actually is.  Now, if it's the
> >> social media junk, I think calling it "data" is sort of a stretch ...
> >
> > Many in our industry don't know what it means but it is something that
> started in 2003 when Google published an ACM paper describing GFS (the
> Google File System) which later morphed into Hadoop and other stuff. Big
> Data really exploded in 2007 but, according to some, the financial meltdown
> of 2007-2008 obscured this paradigm shift.
> >
> > Anyway, here is my point-form explanation for whatever its worth
> >
> > http://neilrieck.net/docs/technological_change.html#epiphany11
> 
> There are a couple of perspectives:
> 
> data science perspective - what data are there and what business value an
> they provide
> 
> IT perspective - how the fuck do we store and search all that data
> 
> Due to our background we may find the second more interesting.
> 
> But it is actually the first that is most important - if there is money to be made
> crunching PB of data, then the IT guys will find a technical way to crunch PB of
> data.
> 
> Arne
> 

<https://www.lifewire.com/what-exactly-is-big-data-4051020> 
" 50% to 80% of big data work is converting and cleaning the information so that is searchable and sortable. Only a few thousand experts on our planet fully know how to do this data cleanup."

Like the large data warehouses of the past,  garbage in, garbage out. If the data is not cleaned up, then it will produce crappy and/or inaccurate results.