2017: Year in Review

And just like that, 2017 is almost gone. Last year, around this time, I wrote a post through which I reflected what I did or did not accomplish in 2016. It is now time to do the same for 2017. A lot happened in 2017 and I would like to take a step back and reflect to make sure I am still pursuing my goals.

Let’s begin!

I started learning AWS

There are a lot of options out there these days when it comes to cloud computing such as Azure, AWS, Google Cloud etc. I decided to pick AWS and learn the basics. There is no doubt that cloud is the way to go. 5-10 years from now, most companies will not have an infrastructure department. It will be provided by third party companies as a service. As far as I am concerned, I am interested in spinning up some EC2 instances on AWS, using S3/Glacier to store files and storing data in an AWS database such as RedShift.


2016: Year in Review

I started EnlistQ in December 2014 as a way for me to express my thoughts and to reinforce technical concepts that I was learning (on my job or elsewhere). This is the first time I have thought of doing a review of my year. It probably has to do with the fact that a lot has changed this year – EnlistQ, my personal and professional life, and the World! All these changes convinced me to take a step back and look at what I have accomplished this year.

Let’s begin!


Using kdb+ for big data analytics in pharmaceutical industry

I attended Kx’s latest meetup in New York this Monday at J.P. Morgan. This meetup was different. It was focused on using kdb+ for data analysis in pharmaceutical industry. I have barely any knowledge about how pharma companies work and what type/size of data they deal with. This meetup was an incredible introduction to growing need of powerful analytical tools in the pharmaceutical industry.

kdb meetup

Kx’s new CEO, Mark Sykes, at the meetup

The event started with a quick introduction by Kx’s new CEO Mark Sykes. I don’t know much about him but he seemed like a nice humble guy. He also announced KxCon that will be held in 2016 in Montauk, New York. Mark led the way for Larry Pickett, CIO of Purdue Pharma, to discuss Purdue’s big data strategy. This was quite high level and am not sure how many people found it interesting. I saw many attendees on their phones during this presentation. I, however, was quite interested in seeing how pharmaceutical companies think differently than financial firms when it comes to big data.



My experience at The Trading Show – quant, automated trading and big data conference

I was lucky enough to get a complimentary pass to The Trading Show from one of our vendors – OneMarketData. They were one of the sponsors and had some spare tickets. The Trading Show is a conference on “quant, automated trading, big data and high performance computing (HPC)”. I have never attended a conference at such a large scale so it was definitely a new experience for me. The event was hosted at Three Sixty Tribeca.

I spent the entire day attending keynotes, panel discussions and round-table discussions, and networking. I will give you a brief summary of what each session covered. For reference, this was the agenda.


Announcement – changes coming to the blog

Few weeks ago, I quit my first job as a q developer and moved to another company. My first job was where I was introduced to q/kdb+ and time-series data. If it wasn’t for that job, I wouldn’t be writing about q on this blog. However, it was time to move on and so I did. While I will still be working with time-series data, I won’t be actively coding in q. I will be using a vendor product called OneTick which is similar to kdb in functionality and comes with many features built-in. Advantage of that is you have a working solution out of the box. On the other hand, it lacks flexibility that comes hand-in-hand with kdb.

Besides learning OneTick, I will also be learning other languages such as perl and python. I have started learning them already and it’s quite interesting programming in other languages when you are coming from a q background. Maybe I will write a post in near future to compare the languages.

I am not abandoning q/kdb. I fully understand the importance and potential of the database and will not be giving up on it. It’s a valuable skill that I intend to take full advantage of. I will continue to develop in q on the side…just not as much. What this means for the blog is that I will be writing about other stuff besides q as well. I will be writing about coding and life as a developer.

Stay tuned for some great new content!