Talking With Dr. Faustman‏

[joshualevy]

A few weeks ago I was able to meet Dr. Denise Faustman in person. We had previously exchanged emails, but this was our first face to face meeting. She was in town (together with Russel, her business development guy) to give a presentation on her research to interested parents. A local family was hosting her presentation, including providing wonderful food and wine for a large number of families to come and hear her. A member of brave buddies worked with the host who was kind enough to invite me. The Initially the plan was for me to just attend. However, they realized that I would have different questions than the other people at the talk, and her answers to my questions would not be of interest to the others. Therefore, they suggested that I come early, and we have a conversation ahead of the regular talk. This sounded like a great idea to me. I asked Dave Forer, another Brave Buddy, to attend as well. Dave is a statistician who has worked on clinical trials for 20 years (although not for type-1 diabetes), so he brought a lot to the table [d1]. (Throughout this posting, marks like [d1] refer to extra discussion at the end of the post.)

This posting is made up of two parts:
1. A status update on Dr. Faustman's BCG research.
2. Some thoughts on speaking directly with Dr. Faustman.

Dr. Faustman is a famous and controversial figure in type-1 research. You can read more about her research in my previous blog postings:
http://cureresearch4type1diabetes.bl...1-history.html

http://cureresearch4type1diabetes.bl...i-results.html

but the bottom line is that in November of 2007 she started a 7 month phase-I clinical trial with BCG which she hoped would cure type-1 diabetes, or at least be part of the cure. Data from that study has not been published.

Status Update and New Information

• The paper with the results from phase-I has been submitted for publication, but has not been accepted for publication, as yet. So no peer-reviewed results (or detailed results of any kind) on the results of her phase-I clinical trial of BCG have been published. Nothing has changed there.
• Dr. Faustman is no longer making public the poster that she had presented at the ADA conference last June 2011. This poster was the most detailed information available on the phase-I clinical trial (including important C-peptide data [d2]) so making it unavailable is a serious step backwards.
• Because it was still being designed, Dr. Faustman would not share with me any details of the planned phase-II clinical trial. (One of her slides said it would include 60 people, but she made it very clear that was a goal, but could change for any number of reasons.)

So my overall summary of movement in the last 8 months is: no visible forward progress, and an important step backward.

Talking to Dr. Faustman

My strongest impression of Dr. Faustman is that she comes across in person just like her advocates come across on the net. She is incredibly optimistic about her research, and extremely driven to move it forward. She is very passionate about it, and that passion comes through everywhere and all the time. She has explanations and reasons for all the delays in her research, all the results that don't quite add up, all the previous failures with BCG, and so on.

However, there is a big difference between talking with Dr. Faustman's advocates on the web, and talking with her in person. When an advocate says something that doesn't mesh with what I know about research, I just assume that person is confused. However, when Dr. Faustman herself says things like that, the effect for me is much more jarring.

The most important example of this is her answer to the question: why were only three people dosed with BCG in the phase-I trial? Read [d3] for discussion of why this is a critical question. Her answer was that the FDA would not allow more people to be dosed. Because of it's importance we spent quite a while discussing this, and she was very consistent that the 3 person trial size was because of the FDA.

However, I've followed dozens of trials aimed at curing type-1 diabetes during this time, and every one of those other trials had more than three people. Some of them involved new drugs, and others involved drugs with known side effects much worse than BCG's side effects. Additionally, I researched all the trials using BCG. There are dozens of those as well, and (again) every one of them uses more than 3 people. Some of those trials involved far larger doses than Dr. Faustman is giving. [d4]

So I am supposed to believe that the FDA went to Dr. Faustman and said something like this: Lots of other people are studying drugs to cure type-1 diabetes. Some of these drugs have never been used for anything before, and we allow all of these groups to test more than 3 people in their trials. Also, lots of other groups are studying BCG specifically for other diseases, sometimes in much higher doses than you are using, and we also allow all those groups to test more than 3 people. However, Dr. Faustman, for you and you alone, we are limiting your phase-I trial to 3 people.

Except I don't believe that. Having Dr. Faustman tell me that the FDA limited her phase-I trial to 3 people created a real credibility gap for me.

There were a total of three issues where things that Dr. Faustman said were not consistent with what I know about research from other sources. Another example was the question: why won't you make the poster public, which you previously showed at the ADA poster session 8 months ago? At first the answer was: ADA won't let me. Neither Dave nor I had ever heard of such a restriction before. The poster was made public at the conference, what possible reason would they have to restrict it later? It's completely unbelievable to me. Dave also expressed his doubts about this explanation [d6], and when he did, the rationale shifted. There were ADA restrictions, but also the authors of the poster had a meeting and decided jointly not to present the poster data publicly any more. So then the question was why? Several reasons were given, all quickly: maybe the data had been misinterpreted by others, maybe they were afraid it would be misinterpreted, maybe they were afraid people would start using BCG off label, maybe the research was limited. But again, in all the dozens of research projects that I've followed, the researchers are always making more data available, not less data [d7].

Because her paper with phase-I results had been submitted for publication, but had not been accepted, we could not talk about any of the data in it.

I also tried to find out why her phase-I trial took so long. When the phase-I study started in Nov-2007, it was supposed to end in July-2008. It actually ended in late 2010 or early 2011. So a 9 month trial actually took about 36 (or a few more) months. I asked specifically about why they stopped recruiting patients for an 8 month period. Read [d8] for more discussion on why this was important. However, that discussion led nowhere, because Dr. Faustman said she did not know about the recruiting gap, and did not want to comment on any of the information in the FDA's clinical trials record.

The result of all this is a lot of frustration for me. I ask about data which should be available. I get reasons why the data is not available. I ask about different data, I get different reasons why it is not available. At the end of the evening I have a large number of reasons [d9] why there is no data, but still there is no data; just requests for funding and support.

After our discussion, I listened to her presentation to the other parents. It was pretty standard stuff about the history of her research including results from her NOD mouse work, and one slide from her human blood work. But for me, one of the striking parts of the evening, was left out of the presentation: There was no information on what had happened to people who had gotten BCG in her phase-I trial! She's trying to raise money for a phase-II trial, without showing the results from her phase-I trial. And we know the phase-I study has been completed and analysed many months ago, because abstracts were presented at the ADA meeting 8 months ago.

Summary

My wife read a draft of this post, and turned to me, and said: "It sounds like she didn't have any new data and you were frustrated." It's a great summary.

I was hoping that speaking directly to Dr. Faustman would give me some understanding on why her phase-I study took so long, was so small, why the results still have not been published, and why she was collecting money for a phase-II study before publication of her phase-I results. All of these actions can be viewed as signs of possible research failure in her phase-I trial. However, none of my questions were answered in a way which allayed my worries.

Thanks!

I want to particularly thank the members of Brave Buddies who went out of their way and put a lot of work into making this meeting possible. I'd also like to thank Dave, who drove a long way, and contributed a lot of knowledge and expertise to the discussion.

Extra Discussion and References

is in the next posting, because this one is to long if I include it here.

Joshua Levy
All the views expressed here are those of Joshua Levy, and nothing here is official JDRF or JDCA news, views, policies or opinions. My blog contains a more complete non-conflict of interest statement.
Clinical Trials Blog: http://cureresearch4type1diabetes.blogspot.com
Cured in Mice Blog: http://t1dcuredinmice.blogspot.com/

[joshualevy]

Extra Discussion and References (from the previous post)

Note that in a couple of cases below, I've quoted Dave from email that he sent me. He gave permission for each quote and reviewed this posting. (All mistakes are my own.)

[d1] The company that Dave works for is a small one, and does not do research, sell, or develop any products for the type-1 diabetes market.

[d2] C-peptides were a secondary outcome of the study. However, they are what the FDA uses to evaluate potential cures for type-1 diabetes, which is why I describe them as an important outcome of the study. The most important outcome, however, is the primary outcome: the measurement of autoantibodies. That data is still a complete mystery.

[d3] Except in a few very rare situations (such as complete cures in all cases), a study that only treats three people is very unlikely to provide strong results. When you are looking for slight improvements, or even medium improvements, three people just isn't enough to rule out random chance. All the people who work with statistics, who gave me opinions on this research, commented on this point. This study is the smallest phase-I clinical trial that I have ever seen in all my coverage of type-1 diabetes research.

[d4] For comparison, phase-I trials of already approved drugs (similar to BCG) include: Anakinra which dosed 15, Etanercept dosed 18, AAT dosed 15, etc. So a 3 person study really stands out as being much smaller than the others.


[d6] In later email, Dave repeated that point: "any poster presented at a scientific meeting is henceforth 'public' and should be disseminated on request. This is a basic convention of science in America and in clinical trials."


[d7] Not showing us the data from the poster did not sit well with Dave, either. Days later he sent me these two quotes:

If she had commercial interest in the drug, there would be more of an argument for confidentiality of the results. But she is very vocal at saying that she wants this drug to be available to all. Therefore she should feel free to show any and all data.

Also, she says that the treatment approach she is pursuing here is one for which the rest of the experts in the field are bearish [negative] on. In all history of science, if a scientist is in disagreement with the rest of their peers, it has always been the case that they show their data to any and all who would spend their time looking at it. They need to convince the rest that they are correct and should jump on any chance they get to show they?re data. That?s science! [emphasis in original]

[d8] Obviously, long delays in a research project are a bad sign. Research is fundamentally uncertain, and while it is common for trials to last a little longer than expected, it is very rare for a type-1 diabetes trial to last more than twice as long as expected, and this trial lasted more than four times as long as expected. The only objective information available to the public on this trial is the clinical trial record, and the record shows that there was an 8 month time period when they officially stopped recruiting patients for the trial, and then started again afterwards. This is very unusual for the type-1 trials that I follow. Only one other study had something similar to this, and it was such a big deal, that they issued a press release to announce it. So asking Dr. Faustman directly about this 8 month hiatus seemed like a good idea.


[d9] I'm deliberately not using the term "excuses" here, because of the negative connotations. But when you are sitting across the table, and asking for data that was publicly shown 8 months ago, and you get this song-and-dance about why it's not available now. Boy, does it sound like an excuse.

The Clinical Trials record, complete with a history of every change made to it, can be seen here:
http://www.clinicaltrials.gov/ct2/show/NCT00607230

Scott King's blog on this research which describes what he saw on the poster:
http://www.hanumanmedicalfoundation....s-i-bgc-trial/

Dr. Faustman's ADA abstract from 2011 is no longer available at the conference web site, but you can see the body here: http://forums.childrenwithdiabetes.c...11&postcount=2

Joshua Levy

[sparty87]

I was wondering what happened to the pending publication of her results following last summer's ADA poster, now I know.

Reading this post brought incredible sadness to me. When my DD was first diagnosed, Faustman's research was one of the first I ran across. I was full of hope that it will lead to a speedy cure.

[Flutterby]

I don't have time to make comments on everything you wrote. But wanted to comment on one thing. If Dr. Faustman said the FDA told her 3 people, then maybe, just maybe they actually did tell her 3 people. Just because you know all about research and what OTHER people/companies have done, it doesn't mean it was the case here.


Not sure why you try to discredit Dr. Faustman so much.

[Deal]

The skeptics of Faustman will continue to grow as time passes without publishing results. She can easily put all the critiques in their place by just being open with what has occurred. She chooses not to.

She must be quite the charismatic speaker to continue to fund raise successfully.

[katerinas]

I think she has discredited herself long ago Joshua did. I really didn't expect anything more or less. Thank you for taking the time and making the effort to see if there was a possibility that she had something meaningfull to say. I personally wouldn't.

[swellman]

Originally Posted by Flutterby

I don't have time to make comments on everything you wrote. But wanted to comment on one thing. If Dr. Faustman said the FDA told her 3 people, then maybe, just maybe they actually did tell her 3 people. Just because you know all about research and what OTHER people/companies have done, it doesn't mean it was the case here.


Not sure why you try to discredit Dr. Faustman so much.

Maybe he doesn't like to see good money go towards, what he feels is, little chance of success - gotta give give credit for putting himself out there.

Personally, I have still reserved judgement primarily because I don't know enough about the politics of clinical trials/FDA and publishing but I have to admit it doesn't bode well that she either hasn't or, perhaps can't, get published. What does it mean to retract a poster? To those in research does that mean anything? Perhaps a clinical trial with an n=3 isn't all that uncommon but if ANYTHING went wrong in the process and the data were questioned then dropping a subject would seem disastrous. I'm not suggesting that is the case only that it seems poorly planned for contingencies.

[Sarah Maddie's Mom]

Originally Posted by swellman

Maybe he doesn't like to see good money go towards, what he feels is, little chance of success - gotta give give credit for putting himself out there.
.

Though, since it's only ever Dr Faustman that he takes the time and energy to critique, it's suspect.

[swellman]

Originally Posted by Sarah Maddie's Mom

Though, since it's only ever Dr Faustman that he takes the time and energy to critique, it's suspect.

Maybe I'm not keeping up but I see him posting on quite a number of research projects and I thought he expressed some personal opinion on a number of them. Maybe not.

What would the motive be if he is disingenuous?

[Deal]

There is no way Joshua is purposely biased against anyone's research. He evaluates it all and he would like nothing more than for it to be successful. His post is a reflection of his attempt to credit her research not his attempt to discredit it. The facts led him to his conclusion, not emotions.

I appreciate his efforts very much and is one of the main reasons I continue to regularly visit this forum.