how do i say that index match is way better than vlookup without getting into another fight with vlady

cowpoker update:




"About 25% done with corn harvest and we are having to pull LP out of Wisconsin and Illinois already for drying. Enormous local corn crop, largest ever by 15+% following up several years of record yields, farmers are not selling because of the lower prices meaning the supply line is plugged tight with many hanging on to corn inventories from '15 and '16 and trying to find space for the huge '17 crop. Many ground bunkers already full and covered and we are barely in to harvest.

Logistical nightmare but I prefer having the surplus problem over a price rationed short supply."

sir ganache bbq:spin: @ 31/10/2017 12:20

how do i say that index match is way better than vlookup without getting into another fight with vlady

I agree, but people who don't know vlookup aren't ready for index match.

Our new staff are usually right out of undergrad so we work them through stuff a bit at a time. Same with SAS- we don't just drop that on them without basic templates to work off of.

vladykins @ 31/10/2017 12:43

sir ganache bbq:spin: @ 31/10/2017 12:20 how do i say that index match is way better than vlookup without getting into another fight with vlady I agree, but people who don't know vlookup aren't ready for index match. Our new staff are usually right out of undergrad so we work them through stuff a bit at a time. Same with SAS- we don't just drop that on them without basic templates to work off of.

most of the time i see people making the switch when they run into memory issues, as vlookup and hlookup bring the entire reference table into memory whereas index only brings in a column.

but now i'm curious about the tools you use. tableau? python? any databases?

sir ganache bbq:spin: @ 31/10/2017 12:51

vladykins @ 31/10/2017 12:43 sir ganache bbq:spin: @ 31/10/2017 12:20 how do i say that index match is way better than vlookup without getting into another fight with vlady I agree, but people who don't know vlookup aren't ready for index match. Our new staff are usually right out of undergrad so we work them through stuff a bit at a time. Same with SAS- we don't just drop that on them without basic templates to work off of. most of the time i see people making the switch when they run into memory issues, as vlookup and hlookup bring the entire reference table into memory whereas index only brings in a column. but now i'm curious about the tools you use. tableau? python? any databases?

SQL mostly for just our web surveys, we crunch a lot of crap using Python (like when we have to pull in data and output into a bunch of readable tables) or we crunch it in SAS). We've been using Tableau for a lot of data visualization, though we're working with Power BI more now because we still have idiots who want their outputs in Powerpoints and Tableau is a pain for that. We have been thinking of integrating out web survey crap all on SPSS so we don't have to have separate data collection and analysis systems, but the firm is slow as hell on shit like that.

vladykins @ 31/10/2017 15:46

SQL mostly for just our web surveys, we crunch a lot of crap using Python (like when we have to pull in data and output into a bunch of readable tables) or we crunch it in SAS). We've been using Tableau for a lot of data visualization, though we're working with Power BI more now because we still have idiots who want their outputs in Powerpoints and Tableau is a pain for that. We have been thinking of integrating out web survey crap all on SPSS so we don't have to have separate data collection and analysis systems, but the firm is slow as hell on shit like that.

good stuff, always interested to see what people are using in the field.

any particular flavor of SQL? i was a postgres fan for a while, but now amazon aurora just solves so many other problems. in fact, i've even been moving certain NoSQL stuff to aurora (especially for production environments). mongo is still easier for cranking out prototypes, but most of what i work with is very easy to port between relational and nonrelational environments, so why not.

for python, are you pulling in data using stuff like requests and beautifulsoup? or is it just reading in csv files and munging with pandas? any numpy/scipy stuff? for some dataviz, seaborn is easy and bokeh is cool, but few firms want to pay analysts to code dataviz -- so i've heard of other firms leaning to powerBI for the same reasons you just mentioned, which makes me wonder where tableau is going to sit in the future. they seem to be veering towards boutique solutions sold by consultants rather than office software you can slowly get going out of the box. i've barely touched SAS or SPSS. licenses are too pricey and if i really want to do stats, R is free.

next question: when your firm is hiring (not that i'm looking for another job), what sort of software skills are they looking for? or is the emphasis just on analytical thinking with the assumption that software skills can be learned on the job?

no....

..not Boolshit

NOT BOOLSHIT!!!!

YOU TWO CAN'T TAKE HER AWAY FROM US!!!

Curtis @ 31/10/2017 16:15

no.... ..not Boolshit NOT BOOLSHIT!!!! YOU TWO CAN'T TAKE HER AWAY FROM US!!!

maybe start thinking of it as "boolean shit" because you know full well what happens when vlady and i decide to make a thread our bitch

see you in a thousand pages

anyone else ever see a wall of text quotes from vlady/cat and just scroll by? because that's what I do. every time.

Pumpkin King @ 31/10/2017 17:14

anyone else ever see a wall of text quotes from vlady/cat and just scroll by? because that's what I do. every time.

are you implying that you read every other post on the entire forum?

sir ganache bbq:spin: @ 31/10/2017 18:17

Pumpkin King @ 31/10/2017 17:14 anyone else ever see a wall of text quotes from vlady/cat and just scroll by? because that's what I do. every time. are you implying that you read every other post on the entire forum?

I read every post besides these exchanges and whatever is happening in Igor's "Hiphop" thread

sir ganache bbq:spin: @ 31/10/2017 18:17

Pumpkin King @ 31/10/2017 17:14 anyone else ever see a wall of text quotes from vlady/cat and just scroll by? because that's what I do. every time. are you implying that you read every other post on the entire forum?

I skip a lot of posts

Curtis @ 31/10/2017 18:35

sir ganache bbq:spin: @ 31/10/2017 18:17 Pumpkin King @ 31/10/2017 17:14 anyone else ever see a wall of text quotes from vlady/cat and just scroll by? because that's what I do. every time. are you implying that you read every other post on the entire forum? I read every post besides these exchanges and whatever is happening in Igor's "Hiphop" thread

I don't think I have wondered into the hiphop thread, I also avoid a lot of sports threads

Curtis @ 31/10/2017 18:35

sir ganache bbq:spin: @ 31/10/2017 18:17 Pumpkin King @ 31/10/2017 17:14 anyone else ever see a wall of text quotes from vlady/cat and just scroll by? because that's what I do. every time. are you implying that you read every other post on the entire forum? I read every post besides these exchanges and whatever is happening in Igor's "Hiphop" thread

Same. I haven't been in Igor's thread since I shared the sewer stylings of Brandon Stuch. As far as I'm concerned that thread is over now.

sir ganache bbq:spin: @ 31/10/2017 16:11

vladykins @ 31/10/2017 15:46 SQL mostly for just our web surveys, we crunch a lot of crap using Python (like when we have to pull in data and output into a bunch of readable tables) or we crunch it in SAS). We've been using Tableau for a lot of data visualization, though we're working with Power BI more now because we still have idiots who want their outputs in Powerpoints and Tableau is a pain for that. We have been thinking of integrating out web survey crap all on SPSS so we don't have to have separate data collection and analysis systems, but the firm is slow as hell on shit like that. good stuff, always interested to see what people are using in the field. any particular flavor of SQL? i was a postgres fan for a while, but now amazon aurora just solves so many other problems. in fact, i've even been moving certain NoSQL stuff to aurora (especially for production environments). mongo is still easier for cranking out prototypes, but most of what i work with is very easy to port between relational and nonrelational environments, so why not. for python, are you pulling in data using stuff like requests and beautifulsoup? or is it just reading in csv files and munging with pandas? any numpy/scipy stuff? for some dataviz, seaborn is easy and bokeh is cool, but few firms want to pay analysts to code dataviz -- so i've heard of other firms leaning to powerBI for the same reasons you just mentioned, which makes me wonder where tableau is going to sit in the future. they seem to be veering towards boutique solutions sold by consultants rather than office software you can slowly get going out of the box. i've barely touched SAS or SPSS. licenses are too pricey and if i really want to do stats, R is free. next question: when your firm is hiring (not that i'm looking for another job), what sort of software skills are they looking for? or is the emphasis just on analytical thinking with the assumption that software skills can be learned on the job?

I'll post on this tomorrow, since I'm outside on phone while giving out candy, but we are looking for more of a data science guy in the near future for our survey team.