DESIGN OF EXPERIMENT

 Hey everyone! Welcome back to my blog 😁In this blog, I will be solving a case study using the DOE method😶Curious to see how I did it? Read on to find out more!

WHAT IS DOE?

DOE (Design Of Experiment) is a methodology to obtain the knowledge of complex, multi-variable processes with the fewest trials possible. 

Let's say we want to find out the effects that a few factors may have on a process. We can do so by varying the values of the factors to see whether the increase or decrease of these factors will affect the process. A much more practical and simpler way would be to use DOE to do so. In DOE, various levels are set for each factor to ensure that a balanced design can be achieved. This allows for a more fair comparison across the factors. 

After which, the results of the different runs are obtained and we can rank the factors based on how significant their effect is on the dependent variable. 

The fundamentals of DOE are as follows: 

1. Response variable (dependent variable)

2. Factor (independent variable)

3. Level 

4. Treatment 

To determine the number of experiments we have to carry out, we have to use the formula N=r2^n,

where N is the total number of experiments, r is the number of replicates, and n is the number of factors. 

In the given case study, there is only 1 replicate, so r=1. There are 3 factors (diameter, microwave time, and power setting of microwave), so n =3. 2^3=8, so the total number of experiments (runs) we have to carry out is 8!

In this case study, I will be examining the significance of the effects of different factors on the loss of popcorn yield. 8 runs were conducted with the HIGH(+) and LOW(-) values of the factors, to see how many un-popped kernels (bullets)  remained in the bag. 


1. Full Factorial data analysis 

1. I made use of the template given to us, and matched the values accordingly. The excel formula rounds up the values to the nearest whole number.  This is how the table looks like: 





2. Next, I calculated the significance of the effects of the different factors by finding the difference between their HIGH (+) and LOW(-) values: 


3. Afterwards, I plotted a graph of the amount of bullets (Dependent variable)  remaining vs the HIGH and LOW values of the factors (Independent variable): 





LET'S STUDY THE RESULTS! 

To determine the effect of single factors, we have to look at the value of the total effect. The higher the value, the more significant of a effect it has on the amount of bullets left behind. 
In this case, we can look at the gradient of the different graphs plotted. The graph with the highest gradient would be the graph of Factor C, which has a gradient of 2.1225 (as shown in the linear equation). Whereas the graph with the lowest gradient would be the graph of Factor A, which has a gradient of 0.1475. 

-For Factor A, when the diameter increased from 10cm to 15cm, the amount of bullets decreased from 1.81g to 1.6625g. 
-For Factor B, when the microwaving time increased from 4 minutes to 6 minutes, the amount of bullets 2.13g to 1.3475g.
-For Factor C, when the power setting of the microwave increased from 75% to 100%, the amount of bullets decreased from 2.80g to 0.675g. 

Since the amount of bullets left behind decreased the most when the power setting of the microwave increased, we can deduce that Factor C has the most significant effect!

Conclusion: 

Now, we can rank the factors from having the most to least significant effect: 
1. Factor C (Power setting of microwave) 
2. Factor B (Microwaving time) 
3. Factor A (Diameter) 


1.1 Interaction effects for Full Factorial

2 factors are said to interact with each other if the effect of one factor on the response variable is different at different levels of the other factor. 

For example, the diameter with a longer microwaving time has different effects than with a shorter microwaving time. 

So, we have to determine the effect of the amount of bullets remaining when 2 different factors interact with each other. 


As shown in the graph, although they have different gradients (positive and negative), the 2 graphs do NOT intersect each other. Hence, there is no interaction. 


As shown in the graph, the 2 graphs DO NOT intersect with each other. Hence, there is no interaction. 



As shown in the graph, the 2 graphs DO NOT intersect with each other. Hence, there is no interaction. 


2. Fractional Factorial data analysis

We will now move on to carry out the Fractional Factorial data analysis for the case study. So, what is the difference between Full Factorial and Fractional Factorial?

In Fractional Factorial, fewer runs are chosen to provide sufficient information to determine the effects of the differen factors. It is more efficient and resource-effective, but the downside is that you may risk missing information😓

For the case study, we will have to choose a subset of 4 runs from a 8 run factorial design. But how do we fractionalise? The 4 runs have to be selected in a way where the design is balanced and varied. It should have good statistical orthogonality, where all factors occur (with both high and low levels) the same nummber of times. 

E.g. Factors A, B, and C need to have 2 HIGH(+) and LOW(-) levels each. That is how we can determine which 4 runs to use. 


For this, I have chosen Runs 1,2,3 and 6. The number of times the HIGH and LOW levels occurred are the same, hence it is balanced. 

Now, we will calculate the significance of the effects of the different factors: 


And a graph can be plotted: 



LET'S STUDY THE RESULTS! 

From the above graph, Factor C has the most significant effect as its gradient is the steepest (2.66), whereas Factor A has the least significant effect as its gradient is the gentlest (0.29) 

-When Factor A increases, the amount of bullets decreases from 2.005g to 1.715g.

-When Factor B increases, the amount of bullets decreases from 2.215g to 1.505g. 

-When Factor C increases, the amount of bullets decreases from 3.19g to 0.53g. 

Conclusion: 

Now, we can rank the factors from the most significant to the least significant:

1. Factor C (Power setting of microwave)

2. Factor B (Microwave time)

3. Factor A (Diameter) 

Excel files:

My own file (with fractional factorial data analysis included): 

https://docs.google.com/spreadsheets/d/16X2ZEwm6pT_iid_TVFn-TwR8egMpvDL6/edit?usp=sharing&ouid=103886194566428202195&rtpof=true&sd=true 

Template used for Full Fractional data analysis :

https://docs.google.com/spreadsheets/d/1wuNq4hVGwgwwYPSbZivDEDw-OJx-UMtC/edit?usp=sharing&ouid=103886194566428202195&rtpof=true&sd=true




3. Learning Reflections: 

Learning about DOE and putting it into practice was not easy for me😰One obstacle I faced was selecting the appropriate 4 runs for the fractional factorial. At first, I did not understand how to select the runs. I was able to understand how the runs are selected during the tutorial lessons as the slides were able to explain the concept to me. I found the illustration of the balanced design using a cube very helpful and from there, I was able to understand why only certain runs can be selected for the fractional factorial. 

However, it was different for the case study as the runs had different HIGH and LOW levels. I later on discovered that the number of HIGH and LOW levels have to occur the same number of times. In this context, when choosing 4 runs, the number of times a HIGH level has to occur is 2 times, and the number of times a LOW level has to occur is 2 times. This has to apply to all 3 factors. Using this understanding, I found it easier to select the 4 runs that will give a balanced design. 

From here, I learned that I have to go through enough practice using the factorial fractional data analysis to really get the hang of choosing 4 selected runs from 8 runs. Now that I understand how to do data analysis for fractional factorial design, I plan to apply it in my subsequent projects, like for my FYP or prototype for this module😄

Practical: 

In the practical, we were to determine the effects of 3 factors: 

1. Factor A : Arm length 

2. Factor B: Projectile weight 

3. Factor C: Stop angle 

On the distance travelled by the projectile. We carried out the full factorial data analysis first, followed by the fractional factorial. The following results were obtained for the Full Factorial run



Effects of each factor: 
For Factor A, when the arm length increases, the distance traveled by the projectile decreases from 110.41cm to 73.03cm. 
For Factor B, when the projectile weight increases, the distance traveled by the projectile decreases from 96.56cm to 86.88cm.
For Factor C, when the stop angle increases, the distance traveled by the projectile decreases from 106.81cm to 76.63cm. 
Factor A has the greatest effect as the gradient of the graph is the steepest. 
More can be seen from the graph being plotted: 

Conclusion: 
If we were to rank the 3 factors (from most significant to least significant): 
1. Factor A (Arm length) 
2. Factor C (Stop angle) 
3. Factor B (Projectile weight) 

Next, we can also determine the interaction effects for the Full Factorial data analysis: 
Between the 2 graphs, there is no intersection. Hence, there is no interaction between A and B. 


Between the 2 graphs, there is an intersection. Hence, there is an interaction between A and C. 


Between the 2 graphs, there is no intersection. Hence, there is no interaction between B and C. 
Factor E has more interaction than Factor D and F. 

The same data analysis can be done for Fractional Factorial: 

Effects of factors: 
For Factor A, as the arm length increases, the distance traveled by the projectile decreases from 103.44cm to 76.28cm. 
For Factor B, as the projectile weight increases, the distance traveled by the projectile increases from 79.78cm to 99.93cm.
For Factor C, as the stop angle increases, the distance traveled by the projectile decreases from 101.72cm to 78cm. 
As shown in the data above, Factor A has the most significant effect as its total effect is the largest, and its gradient is the steepest as shown in the graph below: 


Conclusion: 
Now, we can rank the factors from the most significant to the least significant: 
1. Factor A (Arm length)
2. Factor C (Stop angle) 
3. Factor B (Projectile weight) 

During the DOE practical, I had a lot of fun releasing the catapult at varying levels of factors with my group mates😊Our group managed to finish the first, which I was very happy about😀However, there was some discrepancy with our results. This is because as the weight of our catapult increased, the distance travelled by the catapult also increased. If the weight of our catapult increases, the distance travelled should decrease instead because the heavier weight would drag it down.

I figured that this discrepancy could probably be due to the angle at which we released the catapult from. One of our catappults could not go all the way down, and hence there was a difference between the 2 catapults that were released based on the different HIGH and LOW factors. Next time, we should check and see if there is any faulty equipment before carrying out the runs.

For the group challenge, we were tasked to release the projectile and see if it could hit the targets at different distances. How my group went about doing this was to compare the distance of the target to the nearest distance we obtained from the practical run, and made the adjustments to our catapult accordingly. We changed the arm length, projectile weight, and stop angle according to how near/far the target was from the catapult. 

Unfortunately for the group challenge, my group and I were not able to win any points😭But that's okay! There were 2 instances where we almost hit the standee, but it was not counted as our catapult bounced. In order to fix this, we should consider the release angle (either high, low, or medium) depending on the distance from the target. I realised we did not take that into much account as we relased our catapult from the same angle most of the time. 

Additionally, I realised that the tension in the rubber bands we had was not as high as other groups', and hence it could have affected the distance travelled by our catapult. 

To end it off, I found using the DOE method really effective and useful because it allowed me to account for all the different levels of factors, to reach a more balanced design for data analysis. This allowed me to make a fair comparison between the different factors. I do see myself using this method whenever I have to carry out experiments in the future😁

And with that, that's the end of my blog for DOE! I hope you guys enjoyed reading through and were able to learn new things with me as well😊See you guys in the next blog!😄💥






Comments

Popular Posts