Thursday, 26 June 2014

QlikView Funtions: today() and now()

In this post I want to take a look at two very closely related functions, today() and now(). Many of the more advanced calculations that we want to perform with dates and times require us to know what date it is, and what time it is.

First things first, let us take a look at what the help says about these two functions:

today([timer_mode] )
Returns the current date from the system clock. The timer_mode may have the following values:
0 Date at script run
1 Date at function call
2 Date when the document was opened
Default timer_mode is 2. The timer_mode = 1 should be used with caution, since it polls the operating system every second and hence could slow down the system.

now([timer_mode] )
Returns a timestamp of the current time from the system clock. The timer_mode may have the following values:
0 Time at previously finished reload (not currently ongoing reload)
1 Time at function call
2 Time when the document was opened
Default timer_mode is 1. The timer_mode = 1 should be used with caution, since it polls the operating system every second and hence could slow down the system.

Monday, 23 June 2014

Review of QlikView for Developers Cookbook

Packt Publishing have been slowly but surely securing themselves as the one stop publishing house for QlikView books. With no less than 6 titles now available and more in the pipeline, there can be no doubt they've been busy, but are they worth spending your hard earned cash on?

Some time ago I reviewed their first QlikView book QlikView 11 for Developers which was written by Miguel Garcia and Barry Harmsen and released back in November 2012. The subject of this review is the next book released, QlikView for Developers Cookbook written by Stephen Redmond. I confess I've had this book since it's release, but with a baby QlikView addict at home and endless work commitments, time really hasn't been on my side lately. And as with my previous book reviews, I like to ensure I've not just skimmed through the book but given it a thorough read. There isn't much point in me spouting opinion, and I certainly wouldn't recommend a book unless I honestly knew it's contents in detail. So here goes...


Wednesday, 4 June 2014

Dropping Tables using a Wildcard


Whilst working with a customer last week I had a conversation with one of their developers about dropping tables. The customer wanted to be able to drop all their temporary tables from their model at the end of the script. They used a naming convention in which their temp tables were always named ending in "-temp". Ideally we'd be able to do this using the inbuilt DROP TABLE statement in QlikView script, something like this:

DROP TABLES "*-temp";

Unfortunately this isn't supported and you must explicitly name each table in the DROP TABLE statement. I knew I'd solved this problem before, so after a little digging through old QlikView apps, I finally found the subroutine I'd written and I thought I'd share it with you all.

First of all you need to define the following subroutine at the start of your script. You can simply copy and paste it into your script or you can place it in a text file and include it in your script using the include statement.

SUB WildcardDropTables (vExpression)

    // Loop through the tables within the model
    FOR i = 0 TO noOfTables()-1 STEP 1
      
        // Get the current table name
        LET vCurrTable = tablename(i); // Get the current table name
  
        // If the table name matches the pattern then drop it
        IF wildmatch('$(vCurrTable)','$(vExpression)') THEN
            DROP Table [$(vCurrTable)];
            LET i = i - 1; // Needed as table index reduces once table is dropped
        END IF  
      
    NEXT

    // Clear the variables so they don't persist
    LET vExpression = null();
    LET vCurrTable = null();

END SUB


I've included some comments for those that want to know how it works so I won't bother trying to explain it here.

With the subroutine defined you can call it at any point after and as many times as you like. Calling it is simple as follows:

CALL WildcardDropTables ('*-temp')

If you want to know what is valid to use within the passed pattern, look up the wildmatch() function in the QlikView help.

Now before the best practice police hang me from the rafters, it is indeed best practice to drop a temporary table as soon as is possible within the script to free up the memory it is using. But it's a nice trick and there are always situations where best practice can't be applied.

I've a similar subroutine to drop temporary fields which I'll share soon.

Monday, 12 May 2014

Theft

It saddens me greatly that I'm having to write this post, but here goes...

From time-to-time I receive requests from other websites and authors for permission to reproduce parts of my blog posts. I am normally very flattered that people consider what I write is good enough to reference or reproduce, and until today, I have been more than happy to give approval to such requests. The only thing I have ever asked is that they make it clear what material they have reproduced and to cite the source when doing so.

Unfortunately, I have today come across another blog which has copied images and entire posts word-for-word from QlikViewAddict.com. After taking some legal advice I have sent  the owner of the site a copyright infringement notice. This time I am far from flattered!!!

I am also saddened to say that I recognise material from other prominent QlikView blogs too and so if you are the author of a QV blog, please drop me a message so I can send a link to the offending site. I refuse to advertise it here.

For anyone that wants to use any material from this site, unless otherwise stated, I am the sole author and copyright owner of all material published on QlikViewAddict.com and I politely request that you contact me and ask before doing so. You'll find a big "Contact Me" button at the top of every page of the site and I don't bite (well only at the weekends). I receive a lot of messages via this site and I try to reply to as many as I can. Unfortunately, due to having a family and paying customers to keep happy, I don't get to answer them all but I do my best.

Friday, 24 January 2014

QlikView Functions: autonumber()

Having our new baby (AKA the mini QlikView addict) around has meant very little time for anything, let alone blogging. So in order to ensure I at least manage the odd post or 2 I thought it would be good to start a new series of short posts on different qlikview functions and their uses. To kick things off I have decided to take a look at the autonumber() function and the closely related autonumberhash128() and autonumberhash256(). All 3 functions do a very similar thing so let's look at autonumber() first and then consider how the other 2 functions differ.

Autonumber() can be considered a lookup function. It takes a passed expression and looks up the value in a lookup table. If the expression value isn't found then it is added to the table and assigned an integer value which is returned. If the expression value is found then it returns the integer value that is assigned against it. Simply put, autonumber() converts each unique expression value into a unique integer value.

Autonumber() is only useful within the QlikView script and has the following syntax:

autonumber(expression [, index])

The passed expression can be any string, numeric value or most commonly a field within a loaded table. The passed index is optional and can again be any string or numeric value. For each distinct value within the passed index, QlikView will create a separate lookup table and so the same passed expression values will result in a different returned integer if a different index is specified.

So how exactly are the 3 autonumber functions different? Autonumber() stores the expression value in its lookup table whereas autonumberhash128() stores just the 128bit hash value of the expression value. I'm sure you can guess therefore, autonumberhash256() stores the 256bit hash value expression value.

Why on earth would I want to use any of these functions? Well the answer is quite simply for efficiency. Key fields between two or more tables in QlikView are most efficient if they contain only consecutive integer values starting from 0. All 3 of the autonumber functions allow you to convert any data value and type into a unique integer value and so using it for key fields allow you to maintain optimum efficiency within your data model. 

A final word of warning. All 3 of the autonumber functions have one pitfall, the lookup table(s) exist only whilst the current script execution is active. After the script completes, the lookup table is destroyed and so the same expression value may be assigned different integer values in different script executions. This means that the autonumber functions can't be used for key fields within incremental loads.  

Wednesday, 25 December 2013

Merry Christmas

Just a quick post to wish you all a very merry Christmas. I shall be enjoying our first Christmas with our new junior QlikView addict who it seems has been spoilt rotten.

I've been somewhat lax at posting recently but I'll do my best to get back to writing some more. I have a long list of ideas for new posts.

Regards
Matt

Tuesday, 12 November 2013

QlikView Notepad++ Language Definition v2.2

I've just released a new version of the QlikView Notepad++ Language Definition, mainly to correct an issue with the function list support not working with the latest release of Notepad++ (version 6.5 onwards). This release also contains the following additional fixes/functionality:
  • Corrected a minor issue with the DISTINCT keyword not being highlighted in some situations.
  • Added a check to ensure line comments terminate at an End Of Line (EOL) character.
  • Corrected issue with operator identification. Although operators are not highlighted in QlikView, correct identification prevents incorrect highlighting of keywords and functions when an operator buts up against it. 
  • Added additional operators to fix some minor issues with incorrect highlighting of keywords.

As always, head over to the Notepad++ Language Definition page for the download link and instructions.

Thanks go to Bruno Santos for pointing out the function list issue and testing the fix!

The new version of Notepad++ also has auto-completion turned off by default. You can turn it back on quite easily though:
  1. Select Settings -> Preferences... from the menu bar. 
  2. Select Auto-Completion from the list on the left and then ensure the options are set as follows:

The options under Auto-Insert are optional and enable auto insertion of closing brackets and quotes are automatically entered when an opening bracket or quote is typed.