Our lab has been using JMP for clinical data analysis and mouse data analysis, mostly to account for donor variance and batch differences between mouse experiments. JMP is pretty expensive though, so are these things we could do in R? I know stats and plotting can all be done on R in general, but I'm not exactly sure what JMP does to account for donor/batch differences to find a starting point to learn it in R.

Or is there something cheaper or free that would work? I'd like to avoid the 1400 USD/year price tag, partly because they seem so anti-open source while charging absurd amounts

This is a fairly basic survey question, so hopefully it can get a quick response. Plenty of survey software programs will let you pipe in the responses from one question to use as the rows in a matrix question later on. Say the first question is “list your friends,” then the second is “For each friend check which pets they have… dog, cat, fish, etc.”

I basically want to do that, but in a case where the respondent may have dozens or hundreds of things they’d need to list off in that first question. Is there any survey software that would let you just paste in a list/table or something?

Sorry to ask, btw, when I tried to search for an answer I just got a bunch of results for pre-loading response data. If all else fails I can just have people do everything in a spreadsheet, it’d just be nice if we could use a survey.

I’m working with a version of Pong where, for example, a player has to hit a moving ball with a paddle, but every time they successfully hit the ball, the paddle becomes smaller, making the next hit progressively more difficult. Once they miss, the paddle resets to its original size.

Each round lasts 30 minutes, and I would like to compare performance across rounds.

I also have a chance/control condition where the paddle doesn’t move, so some hits can happen simply by chance.

I would like to get a single normalized hit-rate/performance value for each round that tells me whether the player performed well or poorly overall.

Ideally, this value would take into account:
\- The paddle getting smaller after each successful hit

\- The paddle resetting after a miss

\- The fixed 30-minute duration

\- Different numbers of hits and misses across rounds

\- The chance-level performance from the stationary-paddle condition

What would be the best way to calculate this as one normalized value? I’m particularly interested in something that accounts for the increasing difficulty as the paddle gets smaller, rather than just calculating hits / total attempts. I have tried to calculate a score using the difference between the actual number of hits and the expected value of hits, but I think it does not take into account the paddle starting from where they last hit the ball (if it did not miss).

Also, if anyone knows of similar studies or experiments that have used a comparable normalized performance/hit-rate metric, I’d really appreciate any references or examples. Thank youu

Hi, I'd like to make an analysis on Procurement Auction/ Call for Tenders, but I can't find the losing bids for every bid in my state (Italy). Can I calculate the winner'curse anyway or what others data can I calculate to make my analysis still informative? Thanks all

Hi everyone,

I'm in my last semester of a Master's program in Applied Mathematics (with coursework in statistics and numerical analysis), and I'm currently applying to Statistics PhD programs.

Since my background is not in mathematics (my Bachelor's is in Computer Science), I thought that taking an introductory real analysis course would be beneficial. I don't think that the content itself is too bad, but I find it boring, and the workload has been unreal: frequent detailed readings of notes, several weekly quizzes, and weekly problem sets. Coupled with other courses that I'm taking this semester (Mathematical Statistics 2, Linear Models, and a probability elective), I have not really had the time or energy to invest in order to do well in the course (I have a midterm in a few days and I think that I'll genuinely fail). As such, I'm considering dropping the course and focusing on my other classes. However, I know that real analysis is a key course in Statistics PhD programs, and I'm unsure if having a W in analysis on a transcript would harm my chances of admission. At the same time, even if I do pass, I am pretty sure that I will make a C at best.

Is it worth dropping the course and having a stain on my transcript, or should I tough it out and just try to pass? Another thing to note is that I have a midterm for another course (Linear Models) a few days after my Analysis exam, and part of me thinks that my time would be better spent studying for it rather than memorizing 20+ proofs for my Analysis exam.

Around June to August 2027 I will be graduating with a PhD in Statistics from one of the top 10 programs in the USA.

For quite a few years I was convinced I wanted to pursue a career in academia. Now that I have started my 5th year in the PhD program, I am having a somewhat late realization that academia is not for me.

During my PhD, I have been completely out of tune with what's going on in industry and what skillsets are valuable. I never did an industry internship during my PhD, because I was so focused on academia. I feel like I have no idea what I am doing when it comes to applying to these types of jobs, so I wanted to ask a few questions about this.

I wanted to get a pulse on what's going on in industry right now in 2026, for someone like me who is nearing graduation with a PhD. I also jumped straight from a bachelor's degree into a PhD, so I have no real work experience, which I am now noticing has made me feel very out-of-touch with non academic pathways.

1. What types of industries hire statistics PhDs? I am broadly aware of tech, biotech, finance, etc. What type of work do statistics PhDs do in roles in these areas?
2. Are remote jobs still a thing, or is that a bygone thing from the covid era? I have a strong preference to stay in my location (a major west coast city), so am either restricted to that location, or needing to find remote work, which I might even prefer.
3. Are there any skills I should be developing in the meantime before applying? I have a strong proficiency in R and Python for research purposes, but zero experience with "deploying models," or things of that nature.
4. When do jobs get posted for someone looking to start around September 2027?
5. Anything else you can think of that will be helpful for someone making a sharp pivot away from academia and feels like they don't know what they're doing now!

Even if not in response to one of the above points, would love to hear about what any PhDs in here did post-graduation. Anything to ease my anxiety over this whole process.

Hi! We are doing a research paper for a veterinary med subject where we will test an effect of a certain GAG on a chicken embryo. Question is, what would be the best sample size to use? I can only think of using G Power, but from there how do I do it? Sorry I went here because I don't really know what to do, I just got back from uni after doing a gap year.

As an honours year (Australia) student I am doing a methodological statistics research topic relating to multivariate time series under structural breaks.

My literature review involves reading, analyzing, and synthesizing the literature regarding all things time series under structural breaks. The issue is that a lot of the papers use methods that I haven't formally learned, so I am reading these papers just barely able to scrape by in terms of understanding.

Then I have to synthesize all of these somewhat-understandable papers and discuss my potential contribution with my topic. How can I do this when the literature is full of methods and lingo that I have little understanding of?

Thankfully I have a full year to execute this project so plenty of time to understand everything fully, but how do I even get started?

I have been working on causal inference and experimentation frameworks within the e-commerce tech industry lately, specifically dealing with platform behavioral and transaction telemetry data to determine how customers behaves on those e-commerce platforms.

Lately i have been facing problems where standard textbook statistical theory fails when dealing with messy, real-world data distributions as human behaviour is unpredictable and many unexpected things, which i didnt even thought could happen, can happen in the real world. Such as product delivery delay, causing the customers to be angry and hence put them off from buying the product, each of these variables have to be accounted for.

To model and have these unexpected psychological state among customers accounted for, we use variables such as sudden spikes in customer support chat volume, rapid page refreshes, or immediate session drops.

Also, Marketing headers and automated CRM systems love to push blanket promotional campaigns, but as statisticians, we know that measuring simple unadjusted A/B lift is a massive selection-bias trap.

I been trying to come up with a Statistical model that is trying to model complex human behavior—specifically isolating true customer revenue incrementality from dead-weight margin cannibalization. Essentially, trying to answer: Did the coupon cause the revenue spark, or did we just hand a discount to a power-buyer who was already determined to buy anyway even without the vouchers?

Are people in the tech industry genuinely valuing such skills nowadays? Using statistics to model and predict human behaviour and intent, answering questions like does our vouchers and ads really work?

I would love to hear your experiences how do u guys deals with the unpredictable messiness of human intent.

I’m considering taking a statistics course, and I’ve been thinking about the next steps, whether it’s significantly more beneficial for my future career to pursue a technical specialization, a master’s, or even a PhD

I am performing an ordinal regression analysis with 10 predictors, reduced from an original set of 50. Sample size: N = 380. One of these predictors is the primary predictor of interest (Safety Hazards [SH], a continuous variable). The rest are potential confounders of the primary predictor or contributors to the model.

My primary outcome is Job Satisfaction (JS).

I distilled the 10 candidates from the original 50 by running ordinal bivariate regressions on each candidate.

a) A crude model [JS <-- (beta)*SH]

b) 49 adjusted models: [JS <-- (beta)*SH + any of the 49 predictors].

1. If any of the bivariate regressions produced a CIE of 10% or more for the primary predictor, SH, it made the list of 10, regardless of its p- value.
2. If any of the 50 candidates had a p- value of < = 0.1, regardless of its CIE value, it made it to the list of 10 as well.

I sort the list of 10 by CIE value and use that order to determine which variable to test next in the model.

I then begin the final fitting process to extract the most plausible confounders of SH and true model contributors from the 10 predictors. I use 2 different regression methods: Forward Stepwise Regression (FSR) and Backward Stepwise Regression (BSR).

The conditions to stay in the model are: "If the p-value > 0.1 and CIE <10%, then reject from the model; otherwise, retain."

In FSR, I start with a sparse (crude) model, sequentially add a predictor, and test whether it meets the retention criteria. If so, I retain it, add the next predictor to the new model, and apply the same retention/rejection criteria until all predictors have been tested.

In BSR, I start with a full model and sequentially remove predictors, one at a time, and perform similar rejection/retention tests as in FSR until all predictors have been tested.

However, I find that the FSR and BSR algorithms retain and reject different variables. To be clear, about 60% of variables are common to both algorithms.

My question is: why do the FSR and BSR algorithms produce different results?

What is different about starting with a full model (BSR) versus a sparse model (FSR)?

What is different about starting with a sparse model (FSR) versus a full model (BSR)?

Please try to give an explanation that does not involve the term 'variance', as I tried to explain to my PI, only to be told that is the wrong way to explain it.

Thanks

David

Hi all, I picked up an interest in stats after undergrad & got to take it further in grad school. I took two levels of social science stats, advanced analytics & TA’d for undergrad stats.

I haven’t ruled out getting an MS in stats but I guess I still have some imposter syndrome about my fluency & whether I could succeed coming from social sciences. I’m in no rush to go back to grad school, so in the meantime I’d like to shore up my fundamentals & do some self-teaching. My question to this community is: what topics are must-know to be successful in a future Stats grad program & if you have any good free references to pass along (books/youtube playlists) I’d be very appreciative. Currently reading Bayesian Statistics: The Fun Way lol. Thank you!

Hey, I have a decent background for distribution theory and statistical inference. I wanna get into random processes. I have no idea about the resources to start with. Can anyone suggest me some ?
Moreover, are there any discussion groups and channels on telegram ir any other platform specifically for this?

Hello everyone! I hope this is an appropriate place to ask my question. I am a 2nd-year PharmD student who is currently in my first Evidence-Based Medicine class (aka journal club).

We are having an exam next week, and I really wanted to make sure to start brushing up on the things we've learned about so far. So, yesterday I was looking at some research studies on PubMed and trying to review key concepts.

One topic I have been trying to improve my knowledge of is effect size calculations, like Number Needed to Treat/Harm and Cohen's d.

I had thought I was getting a decent grasp on how to calculate these and when to use each one, but then I ran across a study where the primary outcome was the change in occurrences of a certain disease event (I will just refer to this disease event as "episodes," for brevity's sake) from baseline to the end of the study.

So, the results were posted as follows: The intervention treatment group had a change in occurrences of the episode of -25 (that is, they experienced an average of 25 fewer episodes than at baseline), while the control group had a change in episodes of -7. The study authors also included what appears to be an interquartile range alongside each result value.

I doubt my professor will put an article with this exact situation on the exam, but you never know, and since this is stumping me I would really like to try and understand what to do here. I don't think I could use Number Needed to Treat, since these results are not a simple yes/no categorical situation. But I don't know if I could do a Cohen's d, either, since the authors included an interquartile range but not a standard deviation, from what I can tell.

If anyone here in the Statistics subreddit community has any insight or advice about how to tackle the effect size calculations for a study like this, I would be very interested and appreciative to learn more about what to do when I run across this kind of data. Also, please note that NNT/NNH and Cohen's d are the only two effect size measurements this class has taught us, so if another type of calculation besides these ones would be more appropriate here, then it would be one that I have not heard of yet.

I want to study if one technique of teaching has a significant impact on learning. Yes, I could do a pre- and post-test and with a matched pair t-test and look for significance. But my problem is assuming that any teaching will result in some learning. My thought then is to teach in a traditional structure than again (different lesson) in the new method and check for significance between those two scores.

Or would it make sense to include both sets of tests and draw two conclusions

• Leads to significant learning (or not)
• Leads to significant learning (or not) over traditional methods

Hi everyone, just want to preface by saying i am very much a microbiologist and know extremely little in the world of stats. I’ll give some context to my experiment: I preformed an enrichment where i grew bacteria in vials (n= 3) for 6 weeks, then took a portion of those growths and added it into new vials (n=3) for another 6 weeks. The vials let’s say A1, B1, C1 corresponded to the second batch of vials A2, B2, C2 where in the samples from A1 was added to A2 etc. I did this at two different temperatures (20 and 30 degrees). So i have two variables, the time and the temperature, giving me four groups.
Group 1. 20 degrees celsius week 6 (rep1, rep2, rep3)
Group 2. 30 degrees celsius week 6 (rep1, rep2, rep3)
Group 3. 20 degrees celsius week 12 (rep1, rep2, rep3)
Group 4. 30 degrees celsius week 12 (rep1, rep2, rep3)

I have species level relative abundance data from shotgun metagenomic sequencing and want to determine whether community composition differs between the four groups and ideally a post hoc specific to which. The complication is that at each week 12 culture was subcultured from its corresponding week 6 culture with temperatures maintained. Therefore, week 6 and week 12 are linked observations rather than independent samples. There are three lineages per temperature. I’ve tried Bray curtis PERMANOVA in R using vegan::adonis2() with restricted permutations but the permutation schemes i’ve tried don’t test the temperature, week and interaction effects as intended. I also found significantly different multivariate dispersion between the temperature groups.

So my question is:
1. What statistical method would you recommend for testing community composition while accounting for the linked time points?
2. Is there an appropriate permutation scheme or alternative model for testing temperature, time, and their interaction with this design?
3. What methods would be suitable for identifying differentially abundant species from these metagenomic data?

I’m looking for a statistically defensible approach used in similar microbial enrichment or longitudinal studies. References to relevant papers or example R code would be greatly appreciated. Thank you!!!

Context: I have to send my final dissertation manuscript to my committee tomorrow. My chair called me this morning and told me my stats are all wrong because I ran too many tests with too small of a sample (10 participants). When I asked for guidance on resolving this, they said "You want a PhD? Figure it out". I have spent all morning reading resources and I have gotten myself more confused with each one.

This is a single group pre-post design based on feasibility and exploring preliminary clinical outcomes. I originally had planned paired samples t-tests, but I ended up with such a small sample that it would inflate error rate. Also because of the small sample, any assumptions of underlying distributions can't be met, so I'm using exact sign tests. I modeled my stats after another published pilot study with 7 participants and 15 comparisons. They do not do a correction.

I ran the 7 exact sign tests for my outcome variables, found significance in 6/7, and also presented the data visually. If I did a Bonferroni correction to control for multiple comparisons, my new p-value would be .007 and basically impossible to get with exact sign tests. Is my only option to only present stats for my main variable, and only present descriptive/visuals for the rest?

🎞Watch the short demo here: https://www.reddit.com/r/RStudio/s/K88EvqP6EC

Hello everyone! After 8 months (of rather sporadic) work, I am really excited to share the biggest update to SimtablR, an R package designed to streamline the most common analytical tasks in epidemiology and clinical research! (short demo video above)

I do epidemiological research in R, and I kept juggling multiple packages and repeating work just to get tables that were actually informative and ready for a paper. I also found that base R tabulation left a lot to be desired in terms of formatting, but gt_summary was a bit too slow and had a lot of boilerplate. This package is also great for people transitioning from Stata or still learning R!

With this new release, SimtablR now covers most of a typical analysis, from the first cross-table to the finished table in a Word document:

1. tb(): quick, but powerfull tabulation with formatting

• Row/col/total percentages with simple flags (row, col, cell) and adjustable decimals
• Hypothesis tests with one argument (N-1 chi-squared, Fisher when needed, etc.)
• Prevalence ratios, risk ratios or odds ratios with 95% CIs, directly in the table
• SimtablR now picks the right measure (RR, OR or PR) automatically for a stated study design (design = "cohort", "case_control", "cross_sectional")
• New: stratified analysis with Mantel-Haenszel pooled estimates

2. table1(): baseline tables of multiple variables (literally the "table 1")

• Automatically chooses mean (SD) or median (IQR) based on each variable’s distribution
• Reports missing data per variable and group
• Add standardized mean differences with test(smd = TRUE)
• Completely customizable and exportable to all office programs

3. diag_test() and roc(): diagnostic accuracy

• Automatically calculates the confusion matrix, sensitivity, specificity, PPV, NPV, LR+, LR− and accuracy, with exact (Clopper-Pearson) CIs
• New: roc() now gives the AUC with DeLong CIs and the Youden-optimal threshold

4. regtab() and survtab(): regression

• Fits multiple outcomes at once and returns a single publication-ready table
• Does adjusted risk ratios via log-binomial regression (with robust Poisson fallback), robust variance, and Firth regression for rare events
• New: survtab() for Cox models and hazard ratios
• New: autoplot() draws forest plots from any model

5. Reporting and export (new!)

• simtablr() builds Table 1 + Table 2 (crude and adjusted) as a single report which you can then send to word or excell or powerpoint
• as_methods() drafts the statistical methods paragraph from what you actually did with the variables you chose!
• export_docx() / export_xlsx() send everything to Word or Excel
• Journal styles (style("jama"), "nejm", "lancet") or your own with journal_style(), down to the Word table theme. Restyling never changes the underlying numbers and you can use the sabe object for new analysis, even after styling!

6. Statistical guidance (new)

SimtablR prints short notes (with references) when something deserves attention. Examples: an odds ratio with a common outcome, unadjusted p-values, or when the distribution of your variable violates an assumption from the model you're running. It should just tell you.

The package includes epitabl, a ynthetic cohort of 1,500 patients, so you can replicate the examples of the video

Links:
📦 Documentation: https://matheustg-14.github.io/SimtablR/
📄 Getting started: https://matheustg-14.github.io/SimtablR/articles/getting-started.html
🐛 GitHub (issues & feature requests): https://github.com/MatheusTG-14/SimtablR

Thanks to everyone who gave feedback on the first version! I’d love to hear what you think, what’s missing from your workflow, and any bugs you find on GitHub.

You'll see why I didn't spell out "AGD" when you look at the paper :)

While watching the Netflix documentary about plastics and fertility ("The Plastic Detox"), they had a shot of Dr. Swan's paper. The voiceover talked about how strong the relationship was between AGD and semen concentration.

Problem was that the scatter plot looked to me like there was hardly any relationship between those two variables.

So I went and looked at the paper (better format) and, while the R squared values for the plots in Figure 3 weren't given, it looked really low. Table 3 above claims a very low p value for the AGD and semen concentration.

image of plot and table

So the authors are claiming a relationship there and I'm not really understanding why the relationship doesn't show up in the scatter plot and why their beta coefficient and low p value does indicate a relationship.

Not well versed in statistics, so please ELI5.

I saw this analogy made comparing AI finding proofs to open mathematical conjectures with AI constructing a model that finds a compound for treating cancer and statistically predicting that it would pass a Phase III clinical trial.

This seems like a problematic comparison to me because finding a proof to a conjecture is not the same as making a prediction with a statistical model. No matter how good a prediction is on paper, it is still no reason to treat that compound as though it had already passed Phase III (or even Phase I). On the other hand, a proof to a conjecture can be directly checked if it is right or wrong; there is no uncertainty to it. If the proof compiles on Lean, then it means that it is correct in as far as what being correct from compiling on Lean means.

Of course, an AI finding a compound that it predicts will pass a Phase III trial is still informative. It can motivate at least checking if the compound works invitro and if that checks out, one might be more motivated to proceed to a Phase I trial, but you would always still have to do the experiment, right?

Does this make sense or am I missing something?

For a while now, I've been thinking about the biostats MS, but from reading this and other subreddits, I realized the job market may be irredeemably horrible, that I need a Ph.D. for reasonable pay, that I should just get a stats MS instead, and what attracted me to was the application, but I'm reading that, while I understood it was more math than bio, apparently it's actually, like, 99% math and 1% bio. Is this an accurate understanding of the state of the biostats degree?

Edit: I should clarify that the math is fine to me, but I'm just less interested if, based on that 1% number, having a passion for observational research in health and bio is kinda irrelevant or unimportant for the job.

Hi. I finished my BS-MS (integrated masters) majoring in maths and minoring in data science from one of the IISERs in India. I graduated this year. During my undergrad, I mostly had mathematics courses and my masters thesis was also in a topic related to number theory and my minor project was in statistical data science. I want go for PhD in statistics preferably in the US and my long term goal is jobs related to finance and quantitative research.

The list of course works I took:

Machine learning, real analysis, linear algebra, group theory, mathematical statistics, numerical analysis, scientific computing, complex analysis, Galois theory, topology, ODE, PDE, probability and stochastic processes, data structures, data analysis and visualization, measure theory, commutative algebra, manifolds, differential geometry, algebraic topology, functional analysis, number theory and cryptography, Fourier analysis.

My GPA is 3.97/4.00.

I have become genuinely interested in statistics through self-studying specially after I graduated and keeping in mind my long term goal, statistics suits more than pure mathematics.

I want to know which US universities should I apply whose PhD programme in statistics department will help me fulfil my long term goal and a tier list of the Unis I can get into (top schools, moderate and safe choices with the best ROIs) realistically specially coming from maths background.

Also, suggestions for unis in Europe/ Asia and masters programmes in mathematical finance/ applied maths with good ROI will be helpful. Any general advice will also be great.

Thank you.

I’m not really interested in becoming an MLE maybe BA or Data Science if my grades improve. I wonder in the age of AI if it’s worth learning how to code or if my time would be better spent just looking at AI code and seeing if it’s doing what I want. I seriously don’t want a job where I have to code frequently because it’s not my thing.

Interested in your thoughts

Edit:

To be clear: I don’t want to have a job where it’s coding intensive or I have to make something production ready. For business analyst or data analyst or aspiring product managers like is it still worth trying to learn to code given essentially “free” nature of code now