1 00:00:00,300 --> 00:00:01,175 Limits. 2 00:00:01,175 --> 00:00:07,240 [MUSIC] 3 00:00:07,240 --> 00:00:11,950 Taylor series can provide some useful intuition for thinking about limits. 4 00:00:11,950 --> 00:00:15,130 For example you might remember thinking about this limit. 5 00:00:15,130 --> 00:00:19,870 The limit as x approaches zero of sine x over x. 6 00:00:20,920 --> 00:00:24,020 And one way to think about this is via Taylor series. 7 00:00:24,020 --> 00:00:26,190 And what do Taylor series tell us? 8 00:00:26,190 --> 00:00:32,638 Well Taylor series tells us that sine of x, its equal to x minus x cubed over 9 00:00:32,638 --> 00:00:37,526 6 plus x to 5th over 5 factorial minus, and the series 10 00:00:37,526 --> 00:00:42,500 would keep on going. But at least I know that 11 00:00:42,500 --> 00:00:48,190 sine of x is approximately x plus, 12 00:00:48,190 --> 00:00:53,660 I'll just write higher order terms. So 13 00:00:53,660 --> 00:00:57,900 if you believe this, you might try to evaluate this limit by making use 14 00:00:57,900 --> 00:01:00,990 of this, admittedly at this point, very vague fact. 15 00:01:00,990 --> 00:01:04,378 So what's the limit then as x approaches 0 16 00:01:04,378 --> 00:01:10,270 of x plus some higher order terms divided by x? 17 00:01:10,270 --> 00:01:13,256 Well that's the sort of limit that I could, you know, really approach. 18 00:01:13,256 --> 00:01:13,540 Right? 19 00:01:13,540 --> 00:01:16,420 I mean it's not a transitional function anymore, it's just it 20 00:01:16,420 --> 00:01:20,620 looks like a polynomial as far as I'm concerned or imagining here. 21 00:01:20,620 --> 00:01:23,460 So I could think about how do I calculate 22 00:01:23,460 --> 00:01:27,580 the limit as x approaches 0 of x plus higher order terms over x. 23 00:01:27,580 --> 00:01:30,150 Well what I would probably want to do is multiply 24 00:01:30,150 --> 00:01:34,590 the numerator and the denominator by 1 over x. 25 00:01:34,590 --> 00:01:38,030 And I've got these higher order terms and the denominator's got x. 26 00:01:38,030 --> 00:01:41,288 So this looks like the limit, as x approaches 0 27 00:01:41,288 --> 00:01:46,490 of the numerator now is 1 plus these higher order terms. 28 00:01:46,490 --> 00:01:47,630 And the denominator is just 1. 29 00:01:47,630 --> 00:01:48,520 And if 30 00:01:48,520 --> 00:01:51,110 I'm taking the limit then, as x approaches 0, be 31 00:01:51,110 --> 00:01:54,030 very tempted to say that the limit is just 1. 32 00:01:54,030 --> 00:01:57,590 And that is not even close to a proof. 33 00:01:57,590 --> 00:01:59,200 Well, what's wrong with this argument? 34 00:01:59,200 --> 00:02:01,750 Well, basically, this is a circular argument. 35 00:02:01,750 --> 00:02:02,750 I mean, how so? 36 00:02:02,750 --> 00:02:05,410 So I'm trying to, trying to calculate the limit of sine 37 00:02:05,410 --> 00:02:09,330 x over x by thinking about a Taylor series for sine. 38 00:02:09,330 --> 00:02:11,570 And to find a Taylor series for sine, right, to find 39 00:02:11,570 --> 00:02:14,770 this Taylor series, I need to be able to differentiate sine. 40 00:02:14,770 --> 00:02:17,910 So what do you have to do to be able to differentiate sine? 41 00:02:17,910 --> 00:02:21,100 Well, if you're trying to differentiate sine, you in 42 00:02:21,100 --> 00:02:24,770 particular need to be able to differentiate sine at 0. 43 00:02:24,770 --> 00:02:27,400 So let me just write down the limit of the 44 00:02:27,400 --> 00:02:31,280 difference quotient that calculates the derivative of sine at 0. 45 00:02:31,280 --> 00:02:39,410 That's the limit as h approaches 0 of sine of 0 plus h minus sine of 0 divided by h. 46 00:02:39,410 --> 00:02:39,620 Right, 47 00:02:39,620 --> 00:02:43,600 this limit is calculating the derivative of sine at 0, cause its the ratio 48 00:02:43,600 --> 00:02:46,670 of how the output changes when you go from 0 to 0 plus h. 49 00:02:46,670 --> 00:02:49,340 That's how the input changes when you go from 0 to h. 50 00:02:51,550 --> 00:02:53,160 Okay. But now, how do I calculate this limit? 51 00:02:53,160 --> 00:02:54,120 Well, what is this limit? 52 00:02:54,120 --> 00:02:59,980 This is this limit, as h goes to 0, of what sine of h minus 53 00:02:59,980 --> 00:03:04,895 sine of 0 oh, sine of 0's 0, so the whole numerator's just sine of h, divided by h. 54 00:03:04,895 --> 00:03:05,910 [LAUGH] 55 00:03:05,910 --> 00:03:11,070 So that's exactly the limit that we've got here, just with x replaced by h. 56 00:03:11,070 --> 00:03:12,550 So what happened here, right? 57 00:03:12,550 --> 00:03:14,960 I'm imagining that I'm trying to calculate 58 00:03:14,960 --> 00:03:17,560 this limit by thinking about Taylor series. 59 00:03:17,560 --> 00:03:19,680 But to calculate the Taylor series for sine, 60 00:03:19,680 --> 00:03:21,100 you have to be able to differentiate sine. 61 00:03:21,100 --> 00:03:23,180 But to be able to differentiate sine, I 62 00:03:23,180 --> 00:03:25,620 really need to know, or calculate, this limit. 63 00:03:25,620 --> 00:03:27,690 So, you know, if you think you're really 64 00:03:27,690 --> 00:03:29,920 proving anything by this method, you're really not. 65 00:03:29,920 --> 00:03:31,950 I mean, this is just a circular argument. 66 00:03:31,950 --> 00:03:35,400 Admittedly, it's a circular argument, in a really big circle! 67 00:03:35,400 --> 00:03:38,210 So maybe it looks like a straight line, or a reasonable 68 00:03:38,210 --> 00:03:42,000 argument, but there really is something essentially circular going on here. 69 00:03:42,000 --> 00:03:45,150 But the fact that the argument's circular, shouldn't stop us 70 00:03:45,150 --> 00:03:49,060 from making use of that kind of thinking where it's appropriate. 71 00:03:49,060 --> 00:03:57,250 Let's find the limit as x approaches 0 of cosine of x minus 1 over the numerator, 72 00:03:57,250 --> 00:04:04,530 divided by sine of x times log of 1 minus x. 73 00:04:04,530 --> 00:04:06,790 That's a very complicated looking limit question. 74 00:04:06,790 --> 00:04:08,600 Let me try to approach that more 75 00:04:08,600 --> 00:04:11,300 complicated limit question by using Taylor series. 76 00:04:11,300 --> 00:04:13,290 So let's think about cosine. 77 00:04:13,290 --> 00:04:15,390 So the Taylor series for cosine looks like this. 78 00:04:15,390 --> 00:04:22,280 Cosine of x is 1 minus x squared over 2 plus, and those higher order terms. 79 00:04:22,280 --> 00:04:27,630 So I'm going to write big O, x to the 4th. And to be a little 80 00:04:27,630 --> 00:04:33,045 more pedantic, I'll say as x approaches 0. And what does this mean? 81 00:04:33,045 --> 00:04:33,350 [LAUGH] 82 00:04:33,350 --> 00:04:36,800 Well, I don't want to talk about this too precisely yet, but 83 00:04:36,800 --> 00:04:39,860 morally, or intuitively at least, you should think about it like this. 84 00:04:39,860 --> 00:04:43,860 Cosine of x is 1 minus x squared over 2 plus, you can just think of 85 00:04:43,860 --> 00:04:46,350 these as being the higher order terms in 86 00:04:46,350 --> 00:04:49,550 the Taylor series expansion of cosine around 0. 87 00:04:49,550 --> 00:04:51,630 Now the next term is an x to the 4th term 88 00:04:51,630 --> 00:04:54,030 but there's also an x to the 6th term and so on. 89 00:04:54,030 --> 00:04:58,660 So what about cosine x minus 1? So that means that cosine 90 00:04:58,660 --> 00:05:06,030 of x minus 1 is negative x squared over 2 plus 91 00:05:06,030 --> 00:05:11,980 more terms of degree at least 4. We can write sine of x in the same way. 92 00:05:11,980 --> 00:05:16,540 Sine of x, now sine also has a Taylor series expansion, it's x. 93 00:05:16,540 --> 00:05:18,860 And then there's higher order terms, right? 94 00:05:18,860 --> 00:05:23,900 So I'm just going to write plus higher order terms starting with an x 95 00:05:23,900 --> 00:05:27,120 cubed term. Let's do the log term. 96 00:05:27,120 --> 00:05:29,940 Well, log of 1 minus x, as a Taylor 97 00:05:29,940 --> 00:05:34,358 series expansion that starts like this, minus x minus x 98 00:05:34,358 --> 00:05:37,742 squared over 2 minus x cubed over 3 minus x 99 00:05:37,742 --> 00:05:41,200 to the 4th over 4 and that keeps on going. 100 00:05:41,200 --> 00:05:48,090 And I could write that as just minus x plus terms of degree at least 2. 101 00:05:48,090 --> 00:05:49,450 Let's put the sine and 102 00:05:49,450 --> 00:05:51,300 log term together. 103 00:05:51,300 --> 00:05:55,840 So let's see, I want to multiply together things that involve these big O's. 104 00:05:55,840 --> 00:05:57,550 So how does that work? 105 00:05:57,550 --> 00:06:02,860 Well I'm trying to calculate sine of x times log of 1 minus x. 106 00:06:02,860 --> 00:06:04,490 I can write down a Taylor series for that, but 107 00:06:04,490 --> 00:06:07,760 I don't want to actually go through the bother of calculating 108 00:06:07,760 --> 00:06:09,380 out what the Taylor series is going to be, so I'm 109 00:06:09,380 --> 00:06:14,670 just going try to multiply together these these, these Taylor series. 110 00:06:14,670 --> 00:06:19,590 So sine of x is x plus terms of degree at least 111 00:06:19,590 --> 00:06:24,770 3, and log of 1 minus x, I mean not everywhere, but at least around 0, is 112 00:06:24,770 --> 00:06:30,210 given by negative x plus terms of degree at least 2. 113 00:06:30,210 --> 00:06:34,570 So now what happens when I multiply together these two Taylor series? 114 00:06:34,570 --> 00:06:39,450 Well I've got an x times a negative x, so that gives me negative x squared. 115 00:06:39,450 --> 00:06:39,690 But what 116 00:06:39,690 --> 00:06:41,080 other terms do I get? 117 00:06:41,080 --> 00:06:44,430 Well, here I've got terms of degree at least 3 times x. 118 00:06:44,430 --> 00:06:46,610 These'll give me terms of degree at least 4. 119 00:06:46,610 --> 00:06:49,020 Things of degree of at least 3 times things of degree 120 00:06:49,020 --> 00:06:51,940 at least 2 will give me thing of degree at least 5. 121 00:06:51,940 --> 00:06:55,890 And I've got x times things of degree of at least 2, so this x 122 00:06:55,890 --> 00:06:58,990 times possibly some x squared terms, that'll give 123 00:06:58,990 --> 00:07:01,110 me somethings of degree of at least 3. 124 00:07:01,110 --> 00:07:05,020 So all told what I know, is that this 125 00:07:05,020 --> 00:07:06,900 Taylor Series, when I multiply them together, 126 00:07:06,900 --> 00:07:09,340 is going to start out minus x squared. 127 00:07:09,340 --> 00:07:12,920 And there's going to be some more terms of degree at least 3. 128 00:07:12,920 --> 00:07:14,770 I'm not bothering to calculate those, right? 129 00:07:14,770 --> 00:07:17,660 They're all sort of hidden in this big O notation. 130 00:07:17,660 --> 00:07:20,720 Now we're in a position to consider the original limit. 131 00:07:20,720 --> 00:07:25,790 So thinking about Taylor series for the numerator and denominator, I might 132 00:07:25,790 --> 00:07:28,080 be tempted or I, this is the limit as x approaches 0. 133 00:07:28,080 --> 00:07:30,110 I've got a Taylor series for cosine of x 134 00:07:30,110 --> 00:07:31,520 minus 1. 135 00:07:31,520 --> 00:07:37,200 It's negative x squared over 2 plus terms, degree at least 4. 136 00:07:37,200 --> 00:07:40,400 And I just found a Taylor series for the denominator by 137 00:07:40,400 --> 00:07:43,260 multiplying together the Taylor series for sine and the Taylor series 138 00:07:43,260 --> 00:07:46,040 for log of 1 minus x, and that ended up being 139 00:07:46,040 --> 00:07:51,070 minus x squared plus some terms of degree at least 3. 140 00:07:51,070 --> 00:07:55,280 Now I could multiply this by just the disguised version 141 00:07:55,280 --> 00:08:01,050 of 1, so 1 over x squared divided by 1 over x squared, and this'll give me what? 142 00:08:01,050 --> 00:08:06,750 The limit as x approaches 0 of this numerator is now minus one 143 00:08:06,750 --> 00:08:12,650 half plus terms of degree at least 2. And the denominator 144 00:08:12,650 --> 00:08:18,350 is now just minus 1 plus terms of degree at least 1. 145 00:08:18,350 --> 00:08:20,690 But what is this limit, right? I'm imagining 146 00:08:20,690 --> 00:08:25,380 that x is approaching 0, so these terms and these terms are both approaching 0, 147 00:08:25,380 --> 00:08:30,570 so the numerator has limit minus one half and the denominator has limit minus 1. 148 00:08:30,570 --> 00:08:35,600 And that means that this limit, the limit of the ratio is just one half. 149 00:08:35,600 --> 00:08:37,120 So maybe, at this point, you're unimpressed. 150 00:08:37,120 --> 00:08:40,080 You're thinking, I could have done that with L'Hopital's rule. 151 00:08:40,080 --> 00:08:40,890 And you'd be right. 152 00:08:40,890 --> 00:08:41,970 I mean, you could have used L'Hopital's rule. 153 00:08:41,970 --> 00:08:44,800 So why are we thinking about Taylor series? 154 00:08:44,800 --> 00:08:46,020 Well, the point here isn't 155 00:08:46,020 --> 00:08:49,050 just that Taylor series are useful computationally. 156 00:08:49,050 --> 00:08:50,660 My claim is that Taylor series is really 157 00:08:50,660 --> 00:08:53,708 providing some deeper insight into what's going on. 158 00:08:53,708 --> 00:08:56,340 So we're presented with this fact, that this limit is equal to one 159 00:08:56,340 --> 00:08:59,840 half and you're probably thinking, who cares, and you'd be right to think that. 160 00:08:59,840 --> 00:09:02,350 Who cares if this limit is equal to one half? 161 00:09:02,350 --> 00:09:05,930 If a machine told me this is equal to one half, I wouldn't care either. 162 00:09:05,930 --> 00:09:08,440 What matters isn't that the machines are telling us that this 163 00:09:08,440 --> 00:09:11,060 is equal to one half or that we've got some horribly 164 00:09:11,060 --> 00:09:15,820 long algebraic calculation that proves to us that this limit is equal to one half. 165 00:09:15,820 --> 00:09:17,890 What really matters here is that this limit is equal 166 00:09:17,890 --> 00:09:21,520 to one half for a reason that human beings can understand. 167 00:09:21,520 --> 00:09:25,550 We can really comprehend why this limit should be equal to one half. 168 00:09:25,550 --> 00:09:27,180 We can think about Taylor series. 169 00:09:27,180 --> 00:09:29,860 And Taylor series are telling us that this numerator looks 170 00:09:29,860 --> 00:09:33,290 like negative X squared over 2 plus higher order terms. 171 00:09:33,290 --> 00:09:36,180 We think about Taylor series for sine, and sine looks 172 00:09:36,180 --> 00:09:41,250 like x plus x cubed over 6 and so on. X plus higher order terms. 173 00:09:41,250 --> 00:09:43,860 The Taylor series for log of 1 minus x, 174 00:09:43,860 --> 00:09:47,300 starts of negative x minus, and then there's more terms. 175 00:09:47,300 --> 00:09:49,795 And when I can multiply together Taylor series, right? 176 00:09:49,795 --> 00:09:52,040 And I multiply together these two series, I'm 177 00:09:52,040 --> 00:09:54,720 getting a Taylor Series for the whole denominator. 178 00:09:54,720 --> 00:09:56,090 And the denominator then looks like 179 00:09:56,090 --> 00:09:58,780 negative x squared plus higher order terms. 180 00:09:58,780 --> 00:10:01,260 And now, I can bring to bear all of the intuition 181 00:10:01,260 --> 00:10:03,802 that I have about limits of rational functions, 182 00:10:03,802 --> 00:10:07,026 limits of polynomials over polynomials, and as x approaches 183 00:10:07,026 --> 00:10:09,196 0, it makes perfect sense then, that if 184 00:10:09,196 --> 00:10:12,120 this is a polynomial, it's really a power series. 185 00:10:12,120 --> 00:10:14,712 But if I'm thinking that this is a polynomial that starts 186 00:10:14,712 --> 00:10:17,412 off negative x squared over 2 plus higher order terms, and 187 00:10:17,412 --> 00:10:20,598 the denominator looks like a polynomial, really a power series, but 188 00:10:20,598 --> 00:10:24,450 it's like a polynomial, negative X squared plus higher order terms. 189 00:10:24,450 --> 00:10:26,380 Well then what happens, right? 190 00:10:26,380 --> 00:10:29,880 The limit is exactly the ratio of these leading terms. 191 00:10:29,880 --> 00:10:32,350 It's negative one half over negative 1. 192 00:10:32,350 --> 00:10:34,790 So the fact that this limit equals one half, you 193 00:10:34,790 --> 00:10:38,590 can understand a reason for it by thinking about Taylor series. 194 00:10:38,590 --> 00:10:41,220 Yeah, wow and that's always the point, right? 195 00:10:41,220 --> 00:10:43,750 The point isn't getting answers, it's getting insight. 196 00:10:43,750 --> 00:10:48,030 The point of mathematics, you know, it isn't truth, it's proof. 197 00:10:48,030 --> 00:10:48,180 Right? 198 00:10:48,180 --> 00:10:51,510 It's not so much whether something's true, but why 199 00:10:51,510 --> 00:10:52,280 is it true. 200 00:10:52,280 --> 00:10:57,985 [SOUND] 201 00:10:57,985 --> 00:11:03,694 [NOISE]