The saving grace this time is that most of the high priority things going on are good- including at work. For instance, I had a great day at work on Friday. I cleared the BS work early and got to spend most of the day working on one of my favorite sorts of technical problems. We're starting to build a system to capture a new type of data, and I'm designing the database to store it. This is complex data that will be accessed in multiple ways by a variety of applications, so it is worth taking the time to think about its natural structure, rather than just letting the requirements of a single application dictate the database design.
I genuinely love this part of my job. I write down the operational requirements, as gathered from the users and the programmers, and mix in my own scientific and technical knowledge, perhaps augmented by a little research. I sketch out ideas (usually on paper), jot down questions, and add more ideas, which produce more questions... until I get stuck. I hit some aspect of the data for which the optimal storage structure is not obvious to me, and I can't immediately think of the questions I need to ask to determine the best structure. I stare at my sketches and my list of questions for a few minutes, waiting to see if something comes to me. And if it doesn't, I go do something else. I work on another task, or I read something random on the internet. (Which of these I do depends on how many other deadlines I have looming and how tired my brain feels.) If it is close to lunch, I eat and then take one more look at my papers before heading out for my walk.
I describe this process as "loading a problem into my brain and then looking away." It is by far the best problem-solving process I've found. And I love it. I love the satisfying mental effort of dissecting the work at hand until I have a clear view of what it is I do not know how to do. I love the feeling of my brain stretching to wrap itself around the gap in my understanding. And I love the almost magical way my brain can fill in that gap if I stop looking at it.
|I need the mental equivalent of this|
This problem-solving process- and the happiness it brings me- is not limited to technical problems. I have similar experiences when sorting through complex project plans, which can be like giant logic problems. My recent experiments with using kanban methods for program management also came from this process. I had a management problem I couldn't see how to solve. I loaded it into my brain and looked away for a surprisingly long time. I picked around the edges of the problem, but couldn't unravel it. I read things I thought might give me ideas, and then I looked away again. Then the idea came to me. I refined it and implemented it, and so far, I'm happy with the results.
To be honest, I get a similar kick out of solving organizational and logistical problems at home, and I use a similar process for it. Basically, anytime I confront a problem I don't know how to solve, I take the same approach: break it down, go as far as I can, then load it into my brain and let my brain magically fill in the gap or suggest new things to research. It can take a long time to work, but I have not had this process fail me yet.
I think a lot of people use a similar process for solving problems, or doing anything creative (and solving a problem is creative: you are creating the solution). A lot of people don't really appreciate how important that "look away" part is, though. My friend @smbaxtersd tweeted a link to this blog post on the creative process today, and I think it really captures the wry, self-effacing humor about the creative process that is so common. I used to feel the same way. I'd try to skip the "look away" step, forcing myself to continue to stare at the papers with the problem. It didn't work. I now consider looking away to be an essential part of the process. In fact, it is how I know I've got a good, interesting problem to solve. If I can solve it without looking away, it was too easy. And while I'm perfectly happy to go months and months at home without a hard problem to solve, if I go too long at work with out a problem I have to look away from to solve, I get restless and unhappy, the same way I get restless if I go too long without any physical exercise. So Friday was a very good day indeed.
What is your problem solving process? Do you like it?